2024-09-18T12:47:17.032 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T12:47:17.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T12:47:17.137 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396 branch: main description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7911396' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 090e6509f8ae300193b1735deab951d46056ec88 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 090e6509f8ae300193b1735deab951d46056ec88 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_nmordech@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 2042 sha1: 090e6509f8ae300193b1735deab951d46056ec88 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFPkbgjxcZFBQ9o8aztzszdkw7v6wOZeXhsYU4sQLfbPu9YfuO084G7/5IhYty4YMs9E2gVG81T/aOQGBp3Iqo= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGet1XAEr+xJUg2gPZoPLsdKHybip7XhGDF9+yswzeHDBEdwCWDndURxv+KZxj1+6k8vBveS0W1cJoihBufp/mg= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_12:39:24 tube: smithi user: nmordech verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T12:47:17.138 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-18T12:47:17.138 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-18T12:47:17.139 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T12:47:17.140 INFO:teuthology.task.internal:Checking packages... 2024-09-18T12:47:17.163 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '090e6509f8ae300193b1735deab951d46056ec88' 2024-09-18T12:47:17.164 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:47:17.164 INFO:teuthology.packaging:ref: None 2024-09-18T12:47:17.164 INFO:teuthology.packaging:tag: None 2024-09-18T12:47:17.164 INFO:teuthology.packaging:branch: main 2024-09-18T12:47:17.164 INFO:teuthology.packaging:sha1: 090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:47:17.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=main 2024-09-18T12:47:17.390 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4987.g5ecc7400 2024-09-18T12:47:17.392 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T12:47:17.399 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T12:47:17.399 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T12:47:17.431 INFO:teuthology.task.internal:Saving configuration 2024-09-18T12:47:17.447 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T12:47:17.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T12:47:17.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:42:17.444359', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFPkbgjxcZFBQ9o8aztzszdkw7v6wOZeXhsYU4sQLfbPu9YfuO084G7/5IhYty4YMs9E2gVG81T/aOQGBp3Iqo='} 2024-09-18T12:47:17.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:42:17.445948', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGet1XAEr+xJUg2gPZoPLsdKHybip7XhGDF9+yswzeHDBEdwCWDndURxv+KZxj1+6k8vBveS0W1cJoihBufp/mg='} 2024-09-18T12:47:17.520 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T12:47:17.533 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-18T12:47:17.533 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-18T12:47:17.533 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T12:47:17.610 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2a7c37bac0>, signals=[15]) 2024-09-18T12:47:17.611 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T12:47:17.617 INFO:teuthology.task.internal:Opening connections... 2024-09-18T12:47:17.617 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-18T12:47:17.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:47:17.694 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-18T12:47:17.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:47:17.766 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T12:47:17.774 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-18T12:47:17.792 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-18T12:47:17.792 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-18T12:47:17.849 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-09-18T12:47:17.849 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-09-18T12:47:17.849 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-09-18T12:47:17.849 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:47:17.849 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:47:17.850 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:47:17.851 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-18T12:47:17.871 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-18T12:47:17.889 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-18T12:47:17.890 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-09-18T12:47:17.947 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:47:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:47:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:47:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:47:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:47:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:47:17.948 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-18T12:47:17.971 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T12:47:17.979 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T12:47:18.006 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T12:47:18.006 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:47:18.009 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:47:18.025 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T12:47:18.030 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T12:47:18.031 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:47:18.066 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:47:18.171 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T12:47:18.223 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T12:47:18.237 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T12:47:18.237 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T12:47:18.237 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:47:18.238 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:47:18.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:47:18.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:47:18.255 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-18T12:47:18.256 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-18T12:47:18.313 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:47:18.313 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-503.el9.x86_64 2024-09-18T12:47:18.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-09-18T12:47:18.314 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:47:18.314 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.14.0-503.el9.x86_64 2024-09-18T12:47:18.314 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2024-09-18T12:47:20.690 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-18T12:47:22.033 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.3 MB 00:01 2024-09-18T12:47:22.411 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-18T12:47:24.751 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-18T12:47:27.811 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-18T12:47:29.495 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-18T12:47:30.591 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-18T12:47:31.643 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.5 MB 00:03 2024-09-18T12:47:33.319 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-18T12:47:34.831 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-18T12:47:36.055 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-18T12:47:38.019 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:47:38.020 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:47:38.109 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:47:38.116 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:47:38.116 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-18T12:47:38.116 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:47:38.116 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:47:38.116 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:47:38.116 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout:Install 4 Packages 2024-09-18T12:47:38.117 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:47:38.118 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 79 M 2024-09-18T12:47:38.118 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 126 M 2024-09-18T12:47:38.118 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:47:38.389 INFO:teuthology.orchestra.run.smithi176.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 382 kB/s | 36 kB 00:00 2024-09-18T12:47:38.807 INFO:teuthology.orchestra.run.smithi176.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-18T12:47:39.649 INFO:teuthology.orchestra.run.smithi176.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-18T12:47:39.949 INFO:teuthology.orchestra.run.smithi176.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-18T12:47:39.949 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:47:39.949 INFO:teuthology.orchestra.run.smithi176.stdout:Total 43 MB/s | 79 MB 00:01 2024-09-18T12:47:40.229 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-18T12:47:40.635 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:47:40.984 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:47:40.984 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:47:41.939 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:47:41.939 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:47:42.094 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:47:42.094 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:47:42.194 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:47:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:47:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:47:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:47:42.204 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:47:42.204 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:47:42.204 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-09-18T12:47:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:47:42.204 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 79 M 2024-09-18T12:47:42.205 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 126 M 2024-09-18T12:47:42.205 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:47:42.789 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-18T12:47:43.631 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-18T12:47:44.323 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-18T12:47:44.357 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:47:45.017 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:47:45.031 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-18T12:47:45.032 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:47:45.032 INFO:teuthology.orchestra.run.smithi120.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-18T12:47:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:47:45.718 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:47:46.067 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:47:46.067 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:47:47.025 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:47:47.026 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:47:47.861 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:47:47.990 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:47:49.471 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:47:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:47:50.217 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:47:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:47:52.876 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:47:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:47:53.118 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:47:57.754 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:47:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:47:58.152 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:03.005 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:35.929 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:36.294 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:36.295 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:48:36.295 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:48:36.295 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:48:37.142 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:48:37.507 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:48:37.595 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:48:37.595 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:48:37.595 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:48:37.595 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:48:37.596 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:48:37.596 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-18T12:48:37.596 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:48:37.596 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:48:37.654 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:48:37.655 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:48:37.655 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -qi grub2-tools 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Name : grub2-tools 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Epoch : 1 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Version : 2.06 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Release : 82.el9 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: x86_64 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Group : Unspecified 2024-09-18T12:48:37.694 INFO:teuthology.orchestra.run.smithi176.stdout:Size : 8274670 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:License : GPLv3+ 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Packager : builder@centos.org 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Vendor : CentOS 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Summary : Support tools for GRUB. 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout:Description : 2024-09-18T12:48:37.695 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:48:37.696 INFO:teuthology.orchestra.run.smithi176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:48:37.696 INFO:teuthology.orchestra.run.smithi176.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:48:37.696 INFO:teuthology.orchestra.run.smithi176.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:48:37.696 INFO:teuthology.orchestra.run.smithi176.stdout:hardware devices. 2024-09-18T12:48:37.696 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:48:37.696 INFO:teuthology.orchestra.run.smithi176.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:48:37.697 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:48:37.758 INFO:teuthology.task.kernel:Updating grub on smithi176 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:48:37.758 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:48:38.433 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-18T12:48:39.723 INFO:teuthology.orchestra.run.smithi176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:48:39.748 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-18T12:48:39.750 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-18T12:48:39.768 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.edPidC4foj 2024-09-18T12:48:39.769 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.edPidC4foj 2024-09-18T12:48:39.835 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.edPidC4foj 2024-09-18T12:48:39.974 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.edPidC4foj is 6KB 2024-09-18T12:48:40.023 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.edPidC4foj 2024-09-18T12:48:40.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:48:40.101 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:48:40.101 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:48:40.101 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:48:40.101 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:48:40.102 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:48:40.250 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-09-18T12:48:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:48:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:48:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:48:41.997 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:48:41.998 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:48:42.363 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:48:42.455 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:48:42.455 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:48:42.455 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:48:42.455 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:48:42.455 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:48:42.455 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T12:48:42.455 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:48:42.456 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:48:42.514 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:48:42.514 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:48:42.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 82.el9 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8274670 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:48:42.550 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:48:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:48:42.552 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-09-18T12:48:42.552 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:48:42.552 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:48:42.552 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:48:42.553 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:48:42.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:48:43.194 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-18T12:48:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:48:44.514 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-18T12:48:44.525 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-18T12:48:44.541 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.UQZVJi3Abr 2024-09-18T12:48:44.542 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UQZVJi3Abr 2024-09-18T12:48:44.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.UQZVJi3Abr 2024-09-18T12:48:44.749 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.UQZVJi3Abr is 6KB 2024-09-18T12:48:44.797 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.UQZVJi3Abr 2024-09-18T12:48:44.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:48:44.876 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:48:44.876 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:48:44.876 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:48:44.876 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:48:44.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:48:45.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-18T12:49:10.277 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-18T12:49:10.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-18T12:49:10.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:49:15.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T12:49:15.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-18T12:49:15.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:49:44.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-18T12:49:49.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-18T12:49:53.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-18T12:49:53.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:49:58.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-18T12:49:58.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:50:12.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-18T12:50:17.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-18T12:50:24.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-18T12:50:24.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:50:24.505 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-18T12:50:24.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-18T12:50:24.901 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:50:24.901 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-18T12:50:24.916 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:50:24.916 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:50:24.917 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:50:24.917 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:50:25.920 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-18T12:50:25.920 DEBUG:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:50:26.052 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2024-09-18T12:50:26.087 DEBUG:teuthology.parallel:result is None 2024-09-18T12:50:29.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-18T12:50:29.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:50:29.357 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-18T12:50:29.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-18T12:50:29.676 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:50:29.676 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-18T12:50:29.691 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:50:29.691 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:50:29.691 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:50:29.691 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:50:30.692 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T12:50:30.692 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:50:30.800 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-18T12:50:30.836 DEBUG:teuthology.parallel:result is None 2024-09-18T12:50:30.836 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T12:50:30.848 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T12:50:30.848 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:50:30.850 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:50:30.868 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T12:50:30.881 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T12:50:30.914 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T12:50:30.914 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:50:30.917 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:50:30.940 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T12:50:30.949 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T12:50:30.949 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:50:30.982 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:50:31.005 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:50:31.007 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:50:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:50:31.020 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:50:31.021 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T12:50:31.027 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T12:50:31.027 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:50:31.063 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:50:31.090 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T12:50:31.098 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T12:50:31.098 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:50:31.131 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:50:31.146 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:50:31.231 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:50:31.277 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:50:31.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:50:31.404 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:50:31.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:50:31.481 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:50:31.523 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:50:31.586 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:50:31.627 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:50:31.667 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:50:31.667 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:50:31.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-18T12:50:31.734 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-18T12:50:31.822 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:50:31.857 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:50:32.313 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T12:50:32.320 INFO:teuthology.task.internal:Starting timer... 2024-09-18T12:50:32.320 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T12:50:32.368 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T12:50:32.400 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-18T12:50:32.401 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-09-18T12:50:32.532 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-09-18T12:50:32.535 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-09-18T12:50:32.620 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-09-18T12:50:32.621 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T12:50:32.622 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-09-18T12:50:32.664 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-09-18T12:50:32.665 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-09-18T12:50:32.691 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-09-18T12:50:32.691 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-09-18T12:50:32.691 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T12:50:32.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:50:32.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T12:50:32.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:50:32.803 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T12:50:32.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:50:32.864 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:50:32.930 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T12:50:32.939 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T12:50:32.952 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T12:50:32.953 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T12:54:15.295 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-18T12:54:15.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-18T12:54:15.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:54:15.375 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-18T12:54:15.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-18T12:54:15.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-18T12:54:15.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:54:15.531 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-18T12:54:15.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-18T12:54:15.610 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T12:54:15.621 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T12:54:15.621 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:54:15.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:54:15.624 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:54:15.624 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:54:15.652 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:54:15.667 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:54:15.683 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:54:15.692 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-09-18T12:54:15.698 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:54:15.703 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-09-18T12:54:15.717 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:54:15.724 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-09-18T12:54:15.731 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:54:15.736 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-09-18T12:54:15.750 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:54:15.764 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:54:15.801 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:54:15.805 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:54:15.805 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-18T12:54:15.805 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.805 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.805 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.805 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.820 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:54:15.823 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:54:15.823 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-18T12:54:15.823 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.823 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.823 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.824 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:54:15.825 INFO:teuthology.run_tasks:Running task install... 2024-09-18T12:54:15.832 DEBUG:teuthology.task.install:project ceph 2024-09-18T12:54:15.833 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'}} 2024-09-18T12:54:15.833 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'} 2024-09-18T12:54:15.833 INFO:teuthology.task.install:Using flavor: crimson 2024-09-18T12:54:15.839 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T12:54:15.839 INFO:teuthology.task.install:extra packages: [] 2024-09-18T12:54:15.839 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '090e6509f8ae300193b1735deab951d46056ec88', 'tag': None, 'wait_for_package': False} 2024-09-18T12:54:15.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:54:15.842 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '090e6509f8ae300193b1735deab951d46056ec88', 'tag': None, 'wait_for_package': False} 2024-09-18T12:54:15.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:54:15.985 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/ 2024-09-18T12:54:15.986 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4931.g090e6509 2024-09-18T12:54:15.999 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/ 2024-09-18T12:54:16.000 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4931.g090e6509 2024-09-18T12:54:16.101 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:54:16.101 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:54:16.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:54:16.111 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-nitzan-crimson-enable-gate-assertions/090e6509f8ae300193b1735deab951d46056ec88/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:54:16.111 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:54:16.111 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:54:16.127 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:54:16.128 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/090e6509f8ae300193b1735deab951d46056ec88/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:54:16.136 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:54:16.136 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/090e6509f8ae300193b1735deab951d46056ec88/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:54:16.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:54:16.202 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:54:16.269 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:54:16.277 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:54:16.334 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-09-18T12:54:16.335 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-09-18T12:54:16.341 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-09-18T12:54:16.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-09-18T12:54:16.559 INFO:teuthology.orchestra.run.smithi120.stdout:45 files removed 2024-09-18T12:54:16.581 INFO:teuthology.orchestra.run.smithi176.stdout:45 files removed 2024-09-18T12:54:16.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw 2024-09-18T12:54:16.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw 2024-09-18T12:54:17.148 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 317 kB/s | 88 kB 00:00 2024-09-18T12:54:17.165 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 324 kB/s | 88 kB 00:00 2024-09-18T12:54:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-18T12:54:17.465 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-18T12:54:17.749 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 8.5 kB/s | 2.1 kB 00:00 2024-09-18T12:54:17.774 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 7.2 kB/s | 2.1 kB 00:00 2024-09-18T12:54:19.358 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.3 MB 00:01 2024-09-18T12:54:21.816 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.3 MB 00:04 2024-09-18T12:54:23.542 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-18T12:54:24.791 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-18T12:54:27.735 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-18T12:54:29.244 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-18T12:54:30.393 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-18T12:54:30.748 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-18T12:54:31.843 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-18T12:54:33.147 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-18T12:54:36.163 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-18T12:54:38.355 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:54:38.358 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:54:38.358 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:54:38.358 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.3.0-4931.g090e6509.el9 ceph 10 M 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.5 M 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.8 M 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.3.0-4931.g090e6509.el9 ceph 6.1 M 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.3.0-4931.g090e6509.el9 ceph 20 M 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.3.0-4931.g090e6509.el9 ceph 25 k 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:54:38.359 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 809 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 557 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 5.4 M 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:54:38.360 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 45 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.3.0-4931.g090e6509.el9 ceph 143 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.3.0-4931.g090e6509.el9 ceph 160 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.3.0-4931.g090e6509.el9 ceph 315 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 302 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.3.0-4931.g090e6509.el9 ceph 99 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-09-18T12:54:38.361 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout:Install 31 Packages 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 2 Packages 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 60 M 2024-09-18T12:54:38.362 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:54:38.544 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-09-18T12:54:39.105 INFO:teuthology.orchestra.run.smithi120.stdout:(1/33): ceph-radosgw-19.3.0-4931.g090e6509.el9. 15 MB/s | 10 MB 00:00 2024-09-18T12:54:39.181 INFO:teuthology.orchestra.run.smithi120.stdout:(2/33): ceph-base-19.3.0-4931.g090e6509.el9.x86 8.1 MB/s | 6.1 MB 00:00 2024-09-18T12:54:39.206 INFO:teuthology.orchestra.run.smithi120.stdout:(3/33): ceph-selinux-19.3.0-4931.g090e6509.el9. 250 kB/s | 25 kB 00:00 2024-09-18T12:54:39.240 INFO:teuthology.orchestra.run.smithi120.stdout:(4/33): libcephfs2-19.3.0-4931.g090e6509.el9.x8 14 MB/s | 809 kB 00:00 2024-09-18T12:54:39.273 INFO:teuthology.orchestra.run.smithi120.stdout:(5/33): libradosstriper1-19.3.0-4931.g090e6509. 8.1 MB/s | 557 kB 00:00 2024-09-18T12:54:39.341 INFO:teuthology.orchestra.run.smithi120.stdout:(6/33): python3-ceph-argparse-19.3.0-4931.g090e 677 kB/s | 45 kB 00:00 2024-09-18T12:54:39.407 INFO:teuthology.orchestra.run.smithi120.stdout:(7/33): python3-ceph-common-19.3.0-4931.g090e65 2.1 MB/s | 143 kB 00:00 2024-09-18T12:54:39.508 INFO:teuthology.orchestra.run.smithi120.stdout:(8/33): librgw2-19.3.0-4931.g090e6509.el9.x86_6 20 MB/s | 5.4 MB 00:00 2024-09-18T12:54:39.533 INFO:teuthology.orchestra.run.smithi120.stdout:(9/33): python3-cephfs-19.3.0-4931.g090e6509.el 1.2 MB/s | 160 kB 00:00 2024-09-18T12:54:39.567 INFO:teuthology.orchestra.run.smithi120.stdout:(10/33): python3-rados-19.3.0-4931.g090e6509.el 5.3 MB/s | 315 kB 00:00 2024-09-18T12:54:39.592 INFO:teuthology.orchestra.run.smithi120.stdout:(11/33): python3-rbd-19.3.0-4931.g090e6509.el9. 5.0 MB/s | 302 kB 00:00 2024-09-18T12:54:39.617 INFO:teuthology.orchestra.run.smithi120.stdout:(12/33): python3-rgw-19.3.0-4931.g090e6509.el9. 1.9 MB/s | 99 kB 00:00 2024-09-18T12:54:39.809 INFO:teuthology.orchestra.run.smithi120.stdout:(13/33): ceph-common-19.3.0-4931.g090e6509.el9. 14 MB/s | 20 MB 00:01 2024-09-18T12:54:39.860 INFO:teuthology.orchestra.run.smithi120.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 400 kB/s | 107 kB 00:00 2024-09-18T12:54:39.910 INFO:teuthology.orchestra.run.smithi120.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-18T12:54:40.002 INFO:teuthology.orchestra.run.smithi120.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 444 kB/s | 171 kB 00:00 2024-09-18T12:54:40.027 INFO:teuthology.orchestra.run.smithi120.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 737 kB/s | 160 kB 00:00 2024-09-18T12:54:40.078 INFO:teuthology.orchestra.run.smithi120.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-18T12:54:40.103 INFO:teuthology.orchestra.run.smithi120.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 562 kB/s | 42 kB 00:00 2024-09-18T12:54:40.136 INFO:teuthology.orchestra.run.smithi120.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-18T12:54:40.162 INFO:teuthology.orchestra.run.smithi120.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 611 kB/s | 36 kB 00:00 2024-09-18T12:54:40.187 INFO:teuthology.orchestra.run.smithi120.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-18T12:54:40.213 INFO:teuthology.orchestra.run.smithi120.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 624 kB/s | 47 kB 00:00 2024-09-18T12:54:40.263 INFO:teuthology.orchestra.run.smithi120.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-18T12:54:40.288 INFO:teuthology.orchestra.run.smithi120.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-18T12:54:40.305 INFO:teuthology.orchestra.run.smithi120.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 315 kB/s | 26 kB 00:00 2024-09-18T12:54:40.330 INFO:teuthology.orchestra.run.smithi120.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-18T12:54:40.372 INFO:teuthology.orchestra.run.smithi120.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-18T12:54:40.448 INFO:teuthology.orchestra.run.smithi120.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-18T12:54:40.556 INFO:teuthology.orchestra.run.smithi120.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-09-18T12:54:40.648 INFO:teuthology.orchestra.run.smithi120.stdout:(31/33): librados2-19.3.0-4931.g090e6509.el9.x8 17 MB/s | 3.5 MB 00:00 2024-09-18T12:54:40.707 INFO:teuthology.orchestra.run.smithi120.stdout:(32/33): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-18T12:54:40.771 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:54:40.780 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:54:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.3.0-4931.g090e6509.el9 ceph 10 M 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.5 M 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.8 M 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.3.0-4931.g090e6509.el9 ceph 6.1 M 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.3.0-4931.g090e6509.el9 ceph 20 M 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.3.0-4931.g090e6509.el9 ceph 25 k 2024-09-18T12:54:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 809 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 557 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.3.0-4931.g090e6509.el9 ceph 5.4 M 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:54:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 45 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.3.0-4931.g090e6509.el9 ceph 143 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.3.0-4931.g090e6509.el9 ceph 160 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.3.0-4931.g090e6509.el9 ceph 315 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 302 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.3.0-4931.g090e6509.el9 ceph 99 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-09-18T12:54:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout:Install 31 Packages 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 2 Packages 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 60 M 2024-09-18T12:54:40.784 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:54:40.848 INFO:teuthology.orchestra.run.smithi120.stdout:(33/33): librbd1-19.3.0-4931.g090e6509.el9.x86_ 13 MB/s | 3.8 MB 00:00 2024-09-18T12:54:40.853 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:54:40.853 INFO:teuthology.orchestra.run.smithi120.stdout:Total 24 MB/s | 60 MB 00:02 2024-09-18T12:54:40.969 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:54:41.005 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:54:41.005 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:54:41.520 INFO:teuthology.orchestra.run.smithi176.stdout:(1/33): ceph-base-19.3.0-4931.g090e6509.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-18T12:54:41.587 INFO:teuthology.orchestra.run.smithi176.stdout:(2/33): ceph-selinux-19.3.0-4931.g090e6509.el9. 378 kB/s | 25 kB 00:00 2024-09-18T12:54:41.694 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:54:41.694 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:54:41.707 INFO:teuthology.orchestra.run.smithi176.stdout:(3/33): libcephfs2-19.3.0-4931.g090e6509.el9.x8 6.6 MB/s | 809 kB 00:00 2024-09-18T12:54:41.821 INFO:teuthology.orchestra.run.smithi176.stdout:(4/33): ceph-radosgw-19.3.0-4931.g090e6509.el9. 12 MB/s | 10 MB 00:00 2024-09-18T12:54:41.854 INFO:teuthology.orchestra.run.smithi176.stdout:(5/33): libradosstriper1-19.3.0-4931.g090e6509. 3.7 MB/s | 557 kB 00:00 2024-09-18T12:54:41.921 INFO:teuthology.orchestra.run.smithi176.stdout:(6/33): python3-ceph-argparse-19.3.0-4931.g090e 677 kB/s | 45 kB 00:00 2024-09-18T12:54:42.005 INFO:teuthology.orchestra.run.smithi176.stdout:(7/33): python3-ceph-common-19.3.0-4931.g090e65 1.7 MB/s | 143 kB 00:00 2024-09-18T12:54:42.189 INFO:teuthology.orchestra.run.smithi176.stdout:(8/33): ceph-common-19.3.0-4931.g090e6509.el9.x 16 MB/s | 20 MB 00:01 2024-09-18T12:54:42.214 INFO:teuthology.orchestra.run.smithi176.stdout:(9/33): python3-cephfs-19.3.0-4931.g090e6509.el 766 kB/s | 160 kB 00:00 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi176.stdout:(10/33): librgw2-19.3.0-4931.g090e6509.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-18T12:54:42.306 INFO:teuthology.orchestra.run.smithi176.stdout:(11/33): python3-rados-19.3.0-4931.g090e6509.el 2.6 MB/s | 315 kB 00:00 2024-09-18T12:54:42.332 INFO:teuthology.orchestra.run.smithi176.stdout:(12/33): python3-rgw-19.3.0-4931.g090e6509.el9. 1.9 MB/s | 99 kB 00:00 2024-09-18T12:54:42.357 INFO:teuthology.orchestra.run.smithi176.stdout:(13/33): python3-rbd-19.3.0-4931.g090e6509.el9. 2.1 MB/s | 302 kB 00:00 2024-09-18T12:54:42.474 INFO:teuthology.orchestra.run.smithi176.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 640 kB/s | 107 kB 00:00 2024-09-18T12:54:42.499 INFO:teuthology.orchestra.run.smithi176.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-18T12:54:42.524 INFO:teuthology.orchestra.run.smithi176.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 958 kB/s | 160 kB 00:00 2024-09-18T12:54:42.550 INFO:teuthology.orchestra.run.smithi176.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-09-18T12:54:42.600 INFO:teuthology.orchestra.run.smithi176.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 848 kB/s | 42 kB 00:00 2024-09-18T12:54:42.625 INFO:teuthology.orchestra.run.smithi176.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-18T12:54:42.650 INFO:teuthology.orchestra.run.smithi176.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-18T12:54:42.675 INFO:teuthology.orchestra.run.smithi176.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 717 kB/s | 36 kB 00:00 2024-09-18T12:54:42.701 INFO:teuthology.orchestra.run.smithi176.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-18T12:54:42.726 INFO:teuthology.orchestra.run.smithi176.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-18T12:54:42.785 INFO:teuthology.orchestra.run.smithi176.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-18T12:54:42.812 INFO:teuthology.orchestra.run.smithi176.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-18T12:54:42.835 INFO:teuthology.orchestra.run.smithi176.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 276 kB/s | 26 kB 00:00 2024-09-18T12:54:42.860 INFO:teuthology.orchestra.run.smithi176.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T12:54:42.894 INFO:teuthology.orchestra.run.smithi176.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-18T12:54:42.928 INFO:teuthology.orchestra.run.smithi176.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-18T12:54:42.978 INFO:teuthology.orchestra.run.smithi176.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-18T12:54:43.103 INFO:teuthology.orchestra.run.smithi176.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-18T12:54:43.162 INFO:teuthology.orchestra.run.smithi176.stdout:(32/33): librados2-19.3.0-4931.g090e6509.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-18T12:54:43.245 INFO:teuthology.orchestra.run.smithi176.stdout:(33/33): librbd1-19.3.0-4931.g090e6509.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-18T12:54:43.250 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:54:43.251 INFO:teuthology.orchestra.run.smithi176.stdout:Total 24 MB/s | 60 MB 00:02 2024-09-18T12:54:43.265 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:54:43.362 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:54:43.398 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:54:43.398 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:54:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-18T12:54:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:54:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:54:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 3/35 2024-09-18T12:54:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:54:44.083 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:54:44.083 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:54:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:54:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-18T12:54:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-18T12:54:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-18T12:54:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-18T12:54:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-18T12:54:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-18T12:54:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-18T12:54:44.532 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-18T12:54:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9. 11/35 2024-09-18T12:54:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 12/35 2024-09-18T12:54:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-18T12:54:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 14/35 2024-09-18T12:54:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 14/35 2024-09-18T12:54:44.834 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-18T12:54:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-18T12:54:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-18T12:54:45.018 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-18T12:54:45.051 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-18T12:54:45.080 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-18T12:54:45.116 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-18T12:54:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-18T12:54:45.542 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 23/35 2024-09-18T12:54:45.580 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:54:45.634 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 23/35 2024-09-18T12:54:45.664 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 24/35 2024-09-18T12:54:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-18T12:54:46.043 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-18T12:54:46.147 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:54:46.241 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:54:46.300 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-18T12:54:46.329 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 27/35 2024-09-18T12:54:46.330 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 3/35 2024-09-18T12:54:46.351 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:54:46.401 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 27/35 2024-09-18T12:54:46.414 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:54:46.464 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-18T12:54:46.477 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 28/35 2024-09-18T12:54:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-18T12:54:46.514 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x8 29/35 2024-09-18T12:54:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-18T12:54:46.545 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-18T12:54:46.571 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-18T12:54:46.733 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-18T12:54:46.847 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-18T12:54:46.847 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-18T12:54:46.848 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9. 11/35 2024-09-18T12:54:46.877 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 12/35 2024-09-18T12:54:46.956 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-18T12:54:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 14/35 2024-09-18T12:54:47.072 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 14/35 2024-09-18T12:54:47.115 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-18T12:54:47.223 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-18T12:54:47.258 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-18T12:54:47.299 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-18T12:54:47.331 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-18T12:54:47.377 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-18T12:54:47.422 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-18T12:54:47.801 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-18T12:54:47.847 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 23/35 2024-09-18T12:54:47.939 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 23/35 2024-09-18T12:54:47.969 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 24/35 2024-09-18T12:54:48.013 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-18T12:54:48.606 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-18T12:54:48.634 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 27/35 2024-09-18T12:54:48.705 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 27/35 2024-09-18T12:54:48.783 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 28/35 2024-09-18T12:54:48.811 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x8 29/35 2024-09-18T12:54:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:54:48.978 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:54:49.674 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:54:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 31/35 2024-09-18T12:54:49.815 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 31/35 2024-09-18T12:54:49.815 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:54:49.816 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:54:49.816 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:54:49.849 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:54:51.282 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:54:51.324 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:54:52.040 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 30/35 2024-09-18T12:54:52.294 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 31/35 2024-09-18T12:54:52.377 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 31/35 2024-09-18T12:54:52.377 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:54:52.377 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:54:52.377 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:54:52.420 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:00.245 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:00.245 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-09-18T12:55:00.245 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-09-18T12:55:00.245 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-09-18T12:55:00.245 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-09-18T12:55:00.246 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-09-18T12:55:00.246 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-09-18T12:55:00.246 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-09-18T12:55:00.246 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:01.367 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 33/35 2024-09-18T12:55:01.392 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 33/35 2024-09-18T12:55:01.392 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:01.392 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:55:01.393 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:55:01.393 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:55:01.393 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:01.394 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-18T12:55:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-18T12:55:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:02.697 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:02.697 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-09-18T12:55:02.697 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-09-18T12:55:02.697 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-09-18T12:55:02.697 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-09-18T12:55:02.697 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-09-18T12:55:02.697 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-09-18T12:55:02.698 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-09-18T12:55:02.698 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 1/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 3/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 5/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 6/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 7/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9. 8/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x8 9/35 2024-09-18T12:55:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 10/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 11/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 12/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 13/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-18T12:55:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-18T12:55:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-18T12:55:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-18T12:55:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 34/35 2024-09-18T12:55:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-09-18T12:55:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:55:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T12:55:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T12:55:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T12:55:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:55:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:55:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:55:03.778 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 33/35 2024-09-18T12:55:03.804 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 33/35 2024-09-18T12:55:03.804 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:03.804 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:55:03.804 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:55:03.804 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:55:03.804 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:03.806 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-18T12:55:03.881 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-18T12:55:03.881 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:04.033 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-test 2024-09-18T12:55:04.618 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:55:04.751 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:55:04.752 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:55:04.752 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:04.752 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:55:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.3.0-4931.g090e6509.el9 ceph 81 M 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.3.0-4931.g090e6509.el9 ceph 175 k 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:55:04.753 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:04.754 INFO:teuthology.orchestra.run.smithi120.stdout:Install 9 Packages 2024-09-18T12:55:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:04.754 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 83 M 2024-09-18T12:55:04.754 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 775 M 2024-09-18T12:55:04.754 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:55:05.144 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 1/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 3/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 4/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 5/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_6 6/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 7/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9. 8/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x8 9/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 10/35 2024-09-18T12:55:05.145 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 11/35 2024-09-18T12:55:05.146 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 12/35 2024-09-18T12:55:05.146 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 13/35 2024-09-18T12:55:05.146 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-18T12:55:05.146 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-18T12:55:05.146 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-18T12:55:05.146 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-18T12:55:05.146 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-18T12:55:05.147 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-18T12:55:05.148 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.3.0-4931.g090e6509.el9.x86_64 32/35 2024-09-18T12:55:05.148 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-18T12:55:05.148 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 34/35 2024-09-18T12:55:05.201 INFO:teuthology.orchestra.run.smithi120.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 542 kB/s | 94 kB 00:00 2024-09-18T12:55:05.235 INFO:teuthology.orchestra.run.smithi120.stdout:(2/9): libcephsqlite-19.3.0-4931.g090e6509.el9. 845 kB/s | 175 kB 00:00 2024-09-18T12:55:05.402 INFO:teuthology.orchestra.run.smithi120.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 183 kB 00:00 2024-09-18T12:55:05.435 INFO:teuthology.orchestra.run.smithi120.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 2.1 MB/s | 513 kB 00:00 2024-09-18T12:55:05.494 INFO:teuthology.orchestra.run.smithi120.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-18T12:55:05.528 INFO:teuthology.orchestra.run.smithi120.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-18T12:55:05.545 INFO:teuthology.orchestra.run.smithi120.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-18T12:55:05.595 INFO:teuthology.orchestra.run.smithi120.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-18T12:55:06.095 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-18T12:55:06.095 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:06.095 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-18T12:55:06.095 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.095 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.095 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:55:06.095 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:55:06.096 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:06.097 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T12:55:06.098 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T12:55:06.098 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T12:55:06.098 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:55:06.098 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:55:06.098 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:06.098 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:55:06.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-test 2024-09-18T12:55:07.069 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:29 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:55:07.201 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:55:07.202 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:55:07.202 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:07.202 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:55:07.202 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.3.0-4931.g090e6509.el9 ceph 81 M 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.3.0-4931.g090e6509.el9 ceph 175 k 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout:Install 9 Packages 2024-09-18T12:55:07.203 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:07.204 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 83 M 2024-09-18T12:55:07.204 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 775 M 2024-09-18T12:55:07.204 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:55:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:(9/9): ceph-test-19.3.0-4931.g090e6509.el9.x86_ 34 MB/s | 81 MB 00:02 2024-09-18T12:55:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:Total 31 MB/s | 83 MB 00:02 2024-09-18T12:55:07.517 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:55:07.519 INFO:teuthology.orchestra.run.smithi176.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 890 kB/s | 94 kB 00:00 2024-09-18T12:55:07.539 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:55:07.540 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:55:07.669 INFO:teuthology.orchestra.run.smithi176.stdout:(2/9): libcephsqlite-19.3.0-4931.g090e6509.el9. 684 kB/s | 175 kB 00:00 2024-09-18T12:55:08.116 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:55:08.116 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:55:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 700 kB/s | 513 kB 00:00 2024-09-18T12:55:08.311 INFO:teuthology.orchestra.run.smithi176.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 285 kB/s | 183 kB 00:00 2024-09-18T12:55:08.553 INFO:teuthology.orchestra.run.smithi176.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-18T12:55:08.596 INFO:teuthology.orchestra.run.smithi176.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-18T12:55:08.637 INFO:teuthology.orchestra.run.smithi176.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-18T12:55:08.662 INFO:teuthology.orchestra.run.smithi176.stdout:(8/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 585 kB/s | 64 kB 00:00 2024-09-18T12:55:08.974 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:55:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-18T12:55:09.132 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-18T12:55:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-18T12:55:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-18T12:55:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-18T12:55:09.266 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-18T12:55:09.337 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-18T12:55:09.383 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-18T12:55:09.409 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 8/9 2024-09-18T12:55:09.696 INFO:teuthology.orchestra.run.smithi176.stdout:(9/9): ceph-test-19.3.0-4931.g090e6509.el9.x86_ 35 MB/s | 81 MB 00:02 2024-09-18T12:55:09.699 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:09.700 INFO:teuthology.orchestra.run.smithi176.stdout:Total 33 MB/s | 83 MB 00:02 2024-09-18T12:55:09.785 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:55:09.808 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:55:09.808 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:55:10.385 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:55:10.385 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:55:11.251 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:55:11.326 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-18T12:55:11.381 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-18T12:55:11.434 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-18T12:55:11.467 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-18T12:55:11.509 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-18T12:55:11.549 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-18T12:55:11.625 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-18T12:55:11.675 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-18T12:55:11.710 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 8/9 2024-09-18T12:55:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 8/9 2024-09-18T12:55:20.366 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 9/9 2024-09-18T12:55:22.486 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 8/9 2024-09-18T12:55:22.574 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 9/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 9/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 1/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 2/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-18T12:55:26.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-18T12:55:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T12:55:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:55:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-18T12:55:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:26.855 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:55:27.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph 2024-09-18T12:55:27.827 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:55:27.970 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.3.0-4931.g090e6509.el9 ceph 6.5 k 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.3.0-4931.g090e6509.el9 ceph 2.2 M 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.3.0-4931.g090e6509.el9 ceph 1.6 M 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 291 k 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.3.0-4931.g090e6509.el9 ceph 5.1 M 2024-09-18T12:55:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 70 M 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:55:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:55:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:27.976 INFO:teuthology.orchestra.run.smithi120.stdout:Install 37 Packages 2024-09-18T12:55:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:27.977 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 84 M 2024-09-18T12:55:27.978 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 896 M 2024-09-18T12:55:27.978 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:55:28.390 INFO:teuthology.orchestra.run.smithi120.stdout:(1/37): ceph-19.3.0-4931.g090e6509.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-18T12:55:28.415 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 9/9 2024-09-18T12:55:28.415 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 1/9 2024-09-18T12:55:28.415 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 2/9 2024-09-18T12:55:28.415 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-18T12:55:28.415 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-18T12:55:28.415 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-18T12:55:28.416 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-18T12:55:28.416 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-18T12:55:28.416 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-18T12:55:28.566 INFO:teuthology.orchestra.run.smithi120.stdout:(2/37): ceph-mgr-19.3.0-4931.g090e6509.el9.x86_ 5.2 MB/s | 1.6 MB 00:00 2024-09-18T12:55:28.624 INFO:teuthology.orchestra.run.smithi120.stdout:(3/37): ceph-mds-19.3.0-4931.g090e6509.el9.x86_ 6.0 MB/s | 2.2 MB 00:00 2024-09-18T12:55:28.700 INFO:teuthology.orchestra.run.smithi120.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4931.g090e 3.8 MB/s | 291 kB 00:00 2024-09-18T12:55:28.808 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-18T12:55:28.808 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:28.808 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:55:28.808 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:28.808 INFO:teuthology.orchestra.run.smithi176.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-18T12:55:28.808 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:28.809 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:55:28.841 INFO:teuthology.orchestra.run.smithi120.stdout:(5/37): ceph-mon-19.3.0-4931.g090e6509.el9.x86_ 11 MB/s | 5.1 MB 00:00 2024-09-18T12:55:28.958 INFO:teuthology.orchestra.run.smithi120.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 979 kB/s | 253 kB 00:00 2024-09-18T12:55:29.033 INFO:teuthology.orchestra.run.smithi120.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-18T12:55:29.068 INFO:teuthology.orchestra.run.smithi120.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 5.4 MB/s | 1.2 MB 00:00 2024-09-18T12:55:29.118 INFO:teuthology.orchestra.run.smithi120.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-09-18T12:55:29.143 INFO:teuthology.orchestra.run.smithi120.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-18T12:55:29.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph 2024-09-18T12:55:29.252 INFO:teuthology.orchestra.run.smithi120.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-18T12:55:29.277 INFO:teuthology.orchestra.run.smithi120.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.6 MB/s | 215 kB 00:00 2024-09-18T12:55:29.302 INFO:teuthology.orchestra.run.smithi120.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-18T12:55:29.344 INFO:teuthology.orchestra.run.smithi120.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-18T12:55:29.370 INFO:teuthology.orchestra.run.smithi120.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 376 kB/s | 35 kB 00:00 2024-09-18T12:55:29.395 INFO:teuthology.orchestra.run.smithi120.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-18T12:55:29.420 INFO:teuthology.orchestra.run.smithi120.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-18T12:55:29.471 INFO:teuthology.orchestra.run.smithi120.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-18T12:55:29.496 INFO:teuthology.orchestra.run.smithi120.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-18T12:55:29.521 INFO:teuthology.orchestra.run.smithi120.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-18T12:55:29.555 INFO:teuthology.orchestra.run.smithi120.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-18T12:55:29.580 INFO:teuthology.orchestra.run.smithi120.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-18T12:55:29.606 INFO:teuthology.orchestra.run.smithi120.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 703 kB/s | 18 kB 00:00 2024-09-18T12:55:29.631 INFO:teuthology.orchestra.run.smithi120.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 932 kB/s | 23 kB 00:00 2024-09-18T12:55:29.656 INFO:teuthology.orchestra.run.smithi120.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.6 MB/s | 358 kB 00:00 2024-09-18T12:55:29.681 INFO:teuthology.orchestra.run.smithi120.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 385 kB/s | 19 kB 00:00 2024-09-18T12:55:29.707 INFO:teuthology.orchestra.run.smithi120.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-18T12:55:29.732 INFO:teuthology.orchestra.run.smithi120.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-18T12:55:29.734 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:55:29.757 INFO:teuthology.orchestra.run.smithi120.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T12:55:29.782 INFO:teuthology.orchestra.run.smithi120.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 657 kB/s | 16 kB 00:00 2024-09-18T12:55:29.816 INFO:teuthology.orchestra.run.smithi120.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-18T12:55:29.842 INFO:teuthology.orchestra.run.smithi120.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-18T12:55:29.867 INFO:teuthology.orchestra.run.smithi120.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-09-18T12:55:29.869 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.3.0-4931.g090e6509.el9 ceph 6.5 k 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.3.0-4931.g090e6509.el9 ceph 2.2 M 2024-09-18T12:55:29.872 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.3.0-4931.g090e6509.el9 ceph 1.6 M 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 291 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.3.0-4931.g090e6509.el9 ceph 5.1 M 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 70 M 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:55:29.873 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:55:29.874 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout:Install 37 Packages 2024-09-18T12:55:29.875 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:29.876 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 84 M 2024-09-18T12:55:29.876 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 896 M 2024-09-18T12:55:29.876 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:55:29.892 INFO:teuthology.orchestra.run.smithi120.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-18T12:55:29.926 INFO:teuthology.orchestra.run.smithi120.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 594 kB/s | 20 kB 00:00 2024-09-18T12:55:29.951 INFO:teuthology.orchestra.run.smithi120.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-18T12:55:30.635 INFO:teuthology.orchestra.run.smithi176.stdout:(1/37): ceph-19.3.0-4931.g090e6509.el9.x86_64.r 56 kB/s | 6.5 kB 00:00 2024-09-18T12:55:30.843 INFO:teuthology.orchestra.run.smithi176.stdout:(2/37): ceph-mds-19.3.0-4931.g090e6509.el9.x86_ 6.7 MB/s | 2.2 MB 00:00 2024-09-18T12:55:30.885 INFO:teuthology.orchestra.run.smithi176.stdout:(3/37): ceph-mgr-19.3.0-4931.g090e6509.el9.x86_ 4.3 MB/s | 1.6 MB 00:00 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi176.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4931.g090e 2.8 MB/s | 291 kB 00:00 2024-09-18T12:55:31.044 INFO:teuthology.orchestra.run.smithi120.stdout:(37/37): ceph-osd-19.3.0-4931.g090e6509.el9.x86 28 MB/s | 70 MB 00:02 2024-09-18T12:55:31.047 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:31.047 INFO:teuthology.orchestra.run.smithi120.stdout:Total 27 MB/s | 84 MB 00:03 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi176.stdout:(5/37): ceph-mon-19.3.0-4931.g090e6509.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-18T12:55:31.136 INFO:teuthology.orchestra.run.smithi176.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-18T12:55:31.178 INFO:teuthology.orchestra.run.smithi176.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-18T12:55:31.200 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:55:31.220 INFO:teuthology.orchestra.run.smithi176.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-18T12:55:31.240 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:55:31.240 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:55:31.265 INFO:teuthology.orchestra.run.smithi176.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 6.3 MB/s | 1.2 MB 00:00 2024-09-18T12:55:31.291 INFO:teuthology.orchestra.run.smithi176.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.7 MB/s | 125 kB 00:00 2024-09-18T12:55:31.316 INFO:teuthology.orchestra.run.smithi176.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-18T12:55:31.841 INFO:teuthology.orchestra.run.smithi176.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 343 kB/s | 188 kB 00:00 2024-09-18T12:55:31.866 INFO:teuthology.orchestra.run.smithi176.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 313 kB/s | 172 kB 00:00 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi176.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-18T12:55:31.975 INFO:teuthology.orchestra.run.smithi176.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 712 kB/s | 77 kB 00:00 2024-09-18T12:55:32.030 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:55:32.030 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:55:32.059 INFO:teuthology.orchestra.run.smithi176.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-18T12:55:32.084 INFO:teuthology.orchestra.run.smithi176.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-18T12:55:32.134 INFO:teuthology.orchestra.run.smithi176.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-18T12:55:32.160 INFO:teuthology.orchestra.run.smithi176.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-18T12:55:32.185 INFO:teuthology.orchestra.run.smithi176.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 867 kB/s | 43 kB 00:00 2024-09-18T12:55:32.244 INFO:teuthology.orchestra.run.smithi176.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-18T12:55:32.269 INFO:teuthology.orchestra.run.smithi176.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.6 MB/s | 358 kB 00:00 2024-09-18T12:55:32.294 INFO:teuthology.orchestra.run.smithi176.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 214 kB/s | 11 kB 00:00 2024-09-18T12:55:32.320 INFO:teuthology.orchestra.run.smithi176.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-18T12:55:32.345 INFO:teuthology.orchestra.run.smithi176.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-18T12:55:32.370 INFO:teuthology.orchestra.run.smithi176.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-18T12:55:32.396 INFO:teuthology.orchestra.run.smithi176.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-18T12:55:32.421 INFO:teuthology.orchestra.run.smithi176.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-18T12:55:32.446 INFO:teuthology.orchestra.run.smithi176.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T12:55:32.471 INFO:teuthology.orchestra.run.smithi176.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-18T12:55:32.505 INFO:teuthology.orchestra.run.smithi176.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-18T12:55:32.531 INFO:teuthology.orchestra.run.smithi176.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-18T12:55:32.555 INFO:teuthology.orchestra.run.smithi176.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-18T12:55:33.139 INFO:teuthology.orchestra.run.smithi176.stdout:(34/37): ceph-osd-19.3.0-4931.g090e6509.el9.x86 31 MB/s | 70 MB 00:02 2024-09-18T12:55:33.165 INFO:teuthology.orchestra.run.smithi176.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 364 kB/s | 230 kB 00:00 2024-09-18T12:55:33.208 INFO:teuthology.orchestra.run.smithi176.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 657 kB/s | 427 kB 00:00 2024-09-18T12:55:33.240 INFO:teuthology.orchestra.run.smithi176.stdout:(37/37): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2024-09-18T12:55:33.244 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:33.244 INFO:teuthology.orchestra.run.smithi176.stdout:Total 25 MB/s | 84 MB 00:03 2024-09-18T12:55:33.398 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:55:33.439 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:55:33.439 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:55:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:55:33.754 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T12:55:33.787 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T12:55:33.825 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T12:55:33.894 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T12:55:33.939 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T12:55:33.972 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T12:55:34.064 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T12:55:34.156 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T12:55:34.197 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T12:55:34.233 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T12:55:34.244 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:55:34.244 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:55:34.262 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T12:55:34.297 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T12:55:34.330 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T12:55:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T12:55:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T12:55:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T12:55:34.499 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T12:55:34.537 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T12:55:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T12:55:34.754 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T12:55:34.832 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T12:55:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T12:55:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T12:55:34.989 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T12:55:35.044 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T12:55:35.240 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T12:55:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T12:55:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T12:55:35.453 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T12:55:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T12:55:35.621 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T12:55:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9. 32/37 2024-09-18T12:55:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 33/37 2024-09-18T12:55:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 33/37 2024-09-18T12:55:35.881 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:35.881 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:55:35.881 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:55:35.881 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:55:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:35.950 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:55:36.018 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T12:55:36.050 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T12:55:36.078 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T12:55:36.150 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T12:55:36.194 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T12:55:36.227 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T12:55:36.319 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T12:55:36.397 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T12:55:36.446 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T12:55:36.498 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T12:55:36.528 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T12:55:36.562 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T12:55:36.596 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T12:55:36.636 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T12:55:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T12:55:36.714 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T12:55:36.772 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T12:55:36.803 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T12:55:36.877 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T12:55:37.025 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T12:55:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T12:55:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T12:55:37.194 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T12:55:37.252 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T12:55:37.307 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T12:55:37.503 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T12:55:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T12:55:37.627 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T12:55:37.716 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T12:55:37.756 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T12:55:37.887 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T12:55:38.090 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9. 32/37 2024-09-18T12:55:38.116 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 33/37 2024-09-18T12:55:38.142 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 33/37 2024-09-18T12:55:38.143 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:38.143 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:55:38.143 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:55:38.143 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:55:38.143 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:46.405 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 34/37 2024-09-18T12:55:46.432 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 34/37 2024-09-18T12:55:46.432 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:46.432 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:55:46.432 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:55:46.432 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:55:46.432 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:46.981 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 35/37 2024-09-18T12:55:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 35/37 2024-09-18T12:55:47.004 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:47.004 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:55:47.005 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:55:47.005 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:55:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 36/37 2024-09-18T12:55:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 36/37 2024-09-18T12:55:47.272 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:47.272 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:55:47.272 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:55:47.272 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:55:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.3.0-4931.g090e6509.el9.x86_64 37/37 2024-09-18T12:55:48.666 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 34/37 2024-09-18T12:55:48.693 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 34/37 2024-09-18T12:55:48.693 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:48.693 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:55:48.694 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:55:48.694 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:55:48.694 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:49.233 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 35/37 2024-09-18T12:55:49.258 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 35/37 2024-09-18T12:55:49.258 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:49.258 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:55:49.258 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:55:49.258 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:55:49.258 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:49.492 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 36/37 2024-09-18T12:55:49.516 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 36/37 2024-09-18T12:55:49.516 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:55:49.516 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:55:49.516 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:55:49.516 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:55:49.516 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:49.582 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.3.0-4931.g090e6509.el9.x86_64 37/37 2024-09-18T12:55:54.371 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-2:19.3.0-4931.g090e6509.el9.x86_64 37/37 2024-09-18T12:55:54.371 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.3.0-4931.g090e6509.el9.x86_64 1/37 2024-09-18T12:55:54.371 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 2/37 2024-09-18T12:55:54.371 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 3/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 4/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 5/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9. 6/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T12:55:54.372 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T12:55:54.373 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T12:55:54.374 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T12:55:54.374 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T12:55:54.375 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T12:55:54.375 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T12:55:54.375 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T12:55:54.375 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T12:55:54.375 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T12:55:54.375 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:55.380 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:55:55.381 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:55:55.382 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:55.383 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:55:55.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-base 2024-09-18T12:55:55.849 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-2:19.3.0-4931.g090e6509.el9.x86_64 37/37 2024-09-18T12:55:55.849 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.3.0-4931.g090e6509.el9.x86_64 1/37 2024-09-18T12:55:55.849 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 2/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 3/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 4/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 5/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9. 6/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T12:55:55.850 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T12:55:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T12:55:55.853 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T12:55:55.854 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T12:55:56.246 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:20 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:55:56.336 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:55:56.377 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:55:56.379 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:55:56.379 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:55:56.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install cephadm 2024-09-18T12:55:56.603 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T12:55:56.604 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:55:56.605 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:55:56.606 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:56.607 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:55:56.928 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-base 2024-09-18T12:55:57.027 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:55:57.160 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:55:57.160 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:57.160 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 784 k 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 784 k 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 791 k 2024-09-18T12:55:57.161 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:55:57.448 INFO:teuthology.orchestra.run.smithi120.stdout:cephadm-19.3.0-4931.g090e6509.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-18T12:55:57.448 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:57.448 INFO:teuthology.orchestra.run.smithi120.stdout:Total 2.6 MB/s | 784 kB 00:00 2024-09-18T12:55:57.449 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:55:57.454 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:55:57.454 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:55:57.460 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:55:57.460 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:55:57.534 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:19 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:55:57.537 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:55:57.629 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-base-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:55:57.674 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:55:57.675 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:55:57.675 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:55:57.753 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install cephadm 2024-09-18T12:55:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:55:58.111 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:55:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:20 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:55:58.484 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:55:58.485 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:58.485 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:55:58.485 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:58.485 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:55:58.485 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 784 k 2024-09-18T12:55:58.485 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:58.485 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:55:58.486 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:55:58.486 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:55:58.486 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:55:58.486 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 784 k 2024-09-18T12:55:58.486 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 791 k 2024-09-18T12:55:58.486 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:55:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:55:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:55:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:58.759 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:55:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:55:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:58.760 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:55:58.766 INFO:teuthology.orchestra.run.smithi176.stdout:cephadm-19.3.0-4931.g090e6509.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-18T12:55:58.767 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:58.767 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-18T12:55:58.767 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:55:58.773 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:55:58.773 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:55:58.779 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:55:58.779 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:55:58.854 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:55:58.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:55:59.319 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:55:59.411 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:55:59.582 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:23 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:55:59.715 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:55:59.715 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:59.715 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4931.g090e6509.el9 ceph 158 k 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 158 k 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 644 k 2024-09-18T12:55:59.716 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:55:59.878 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:55:59.938 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-immutable-object-cache-19.3.0-4931.g090e65 711 kB/s | 158 kB 00:00 2024-09-18T12:55:59.939 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:55:59.939 INFO:teuthology.orchestra.run.smithi120.stdout:Total 707 kB/s | 158 kB 00:00 2024-09-18T12:55:59.939 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:55:59.949 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:55:59.949 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:00.006 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:00.006 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:00.129 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:00.129 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:00.129 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:00.129 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:00.129 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:00.129 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:00.240 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:00.265 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:00.266 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:00.266 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:56:00.266 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:00.379 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:56:00.969 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:01.104 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:01.105 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:01.105 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-18T12:56:01.105 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:01.105 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:01.105 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4931.g090e6509.el9 ceph 158 k 2024-09-18T12:56:01.105 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:01.106 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:01.106 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:01.106 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:56:01.106 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:01.106 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 158 k 2024-09-18T12:56:01.106 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 644 k 2024-09-18T12:56:01.106 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:01.233 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:01.233 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:01.316 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-immutable-object-cache-19.3.0-4931.g090e65 754 kB/s | 158 kB 00:00 2024-09-18T12:56:01.316 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:01.317 INFO:teuthology.orchestra.run.smithi176.stdout:Total 748 kB/s | 158 kB 00:00 2024-09-18T12:56:01.317 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:01.326 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:01.326 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:01.383 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:01.384 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:01.492 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr 2024-09-18T12:56:01.531 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:01.634 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:01.659 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:01.659 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:01.659 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:56:01.659 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:02.080 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:02.282 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:56:02.589 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4931.g090e6509. 1/1 2024-09-18T12:56:02.589 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:02.589 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:02.589 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:02.589 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:02.589 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:02.818 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr 2024-09-18T12:56:02.855 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:02.986 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:02.987 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:56:02.987 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:02.987 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:02.987 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 14 M 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 34 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 16 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:56:02.988 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:56:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:02.989 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:02.989 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:02.989 INFO:teuthology.orchestra.run.smithi120.stdout:Install 11 Packages 2024-09-18T12:56:02.989 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:02.989 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 18 M 2024-09-18T12:56:02.989 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 155 M 2024-09-18T12:56:02.990 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:03.402 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:25 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:03.494 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-mgr-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:03.537 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:03.538 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:03.539 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:03.606 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:56:03.952 INFO:teuthology.orchestra.run.smithi120.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4931.g090 68 kB/s | 16 kB 00:00 2024-09-18T12:56:03.977 INFO:teuthology.orchestra.run.smithi120.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4931.g09 127 kB/s | 34 kB 00:00 2024-09-18T12:56:04.119 INFO:teuthology.orchestra.run.smithi120.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-18T12:56:04.178 INFO:teuthology.orchestra.run.smithi120.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-18T12:56:04.180 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:04.195 INFO:teuthology.orchestra.run.smithi120.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-18T12:56:04.228 INFO:teuthology.orchestra.run.smithi120.stdout:(6/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-09-18T12:56:04.287 INFO:teuthology.orchestra.run.smithi120.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-18T12:56:04.304 INFO:teuthology.orchestra.run.smithi120.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-18T12:56:04.314 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:04.315 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:56:04.315 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:04.315 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 14 M 2024-09-18T12:56:04.315 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:56:04.315 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 34 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 16 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:04.316 INFO:teuthology.orchestra.run.smithi176.stdout:Install 11 Packages 2024-09-18T12:56:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:04.317 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 18 M 2024-09-18T12:56:04.317 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 155 M 2024-09-18T12:56:04.317 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:04.355 INFO:teuthology.orchestra.run.smithi120.stdout:(9/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-09-18T12:56:04.379 INFO:teuthology.orchestra.run.smithi120.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-09-18T12:56:04.819 INFO:teuthology.orchestra.run.smithi176.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4931.g09 196 kB/s | 34 kB 00:00 2024-09-18T12:56:04.844 INFO:teuthology.orchestra.run.smithi176.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4931.g090 82 kB/s | 16 kB 00:00 2024-09-18T12:56:04.970 INFO:teuthology.orchestra.run.smithi176.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-09-18T12:56:05.028 INFO:teuthology.orchestra.run.smithi176.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-18T12:56:05.053 INFO:teuthology.orchestra.run.smithi176.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-18T12:56:05.137 INFO:teuthology.orchestra.run.smithi176.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 24 MB/s | 2.0 MB 00:00 2024-09-18T12:56:05.171 INFO:teuthology.orchestra.run.smithi176.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-18T12:56:05.196 INFO:teuthology.orchestra.run.smithi176.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-18T12:56:05.222 INFO:teuthology.orchestra.run.smithi176.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-18T12:56:05.422 INFO:teuthology.orchestra.run.smithi176.stdout:(10/11): ceph-mgr-dashboard-19.3.0-4931.g090e65 18 MB/s | 14 MB 00:00 2024-09-18T12:56:05.555 INFO:teuthology.orchestra.run.smithi120.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4931.g090e65 7.7 MB/s | 14 MB 00:01 2024-09-18T12:56:05.560 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:05.560 INFO:teuthology.orchestra.run.smithi120.stdout:Total 7.1 MB/s | 18 MB 00:02 2024-09-18T12:56:05.594 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:05.597 INFO:teuthology.orchestra.run.smithi176.stdout:(11/11): protobuf-compiler-3.14.0-13.el9.x86_64 1.1 MB/s | 863 kB 00:00 2024-09-18T12:56:05.600 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:05.600 INFO:teuthology.orchestra.run.smithi176.stdout:Total 14 MB/s | 18 MB 00:01 2024-09-18T12:56:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:05.632 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:05.653 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:05.653 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:05.920 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:05.920 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:06.472 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-18T12:56:06.536 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-18T12:56:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-18T12:56:06.567 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-18T12:56:06.653 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-18T12:56:06.667 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-18T12:56:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-18T12:56:06.792 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-18T12:56:06.837 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-18T12:56:06.845 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-18T12:56:06.928 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-18T12:56:06.929 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-18T12:56:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-18T12:56:06.988 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-18T12:56:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-18T12:56:07.025 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-18T12:56:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9 9/11 2024-09-18T12:56:07.057 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9 9/11 2024-09-18T12:56:10.218 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el 10/11 2024-09-18T12:56:10.233 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el 10/11 2024-09-18T12:56:10.278 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 11/11 2024-09-18T12:56:10.288 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 11/11 2024-09-18T12:56:12.164 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 11/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el 1/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 2/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9 3/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-18T12:56:12.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-18T12:56:12.283 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 11/11 2024-09-18T12:56:12.283 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el 1/11 2024-09-18T12:56:12.283 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noa 2/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9 3/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-18T12:56:12.284 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-18T12:56:12.468 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-18T12:56:12.468 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:12.468 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:12.468 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T12:56:12.468 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:12.468 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:12.469 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:12.597 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-18T12:56:12.597 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:12.597 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:12.597 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:12.598 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:12.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:56:12.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:56:13.321 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:13.454 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:13.455 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-18T12:56:13.455 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:56:13.455 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-18T12:56:13.455 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:13.455 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 7.4 M 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:56:13.456 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:13.457 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:13.457 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-18T12:56:13.457 INFO:teuthology.orchestra.run.smithi176.stdout:Install 12 Packages 2024-09-18T12:56:13.457 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:13.457 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 38 M 2024-09-18T12:56:13.457 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 212 M 2024-09-18T12:56:13.458 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:13.459 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:13.591 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:13.592 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-09-18T12:56:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:56:13.592 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 7.4 M 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:56:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout:Install 12 Packages 2024-09-18T12:56:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:13.595 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 38 M 2024-09-18T12:56:13.595 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 212 M 2024-09-18T12:56:13.595 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:13.896 INFO:teuthology.orchestra.run.smithi120.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-18T12:56:13.947 INFO:teuthology.orchestra.run.smithi120.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-18T12:56:13.994 INFO:teuthology.orchestra.run.smithi176.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 898 kB/s | 191 kB 00:00 2024-09-18T12:56:14.063 INFO:teuthology.orchestra.run.smithi120.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-18T12:56:14.102 INFO:teuthology.orchestra.run.smithi176.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-18T12:56:14.113 INFO:teuthology.orchestra.run.smithi120.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-18T12:56:14.119 INFO:teuthology.orchestra.run.smithi176.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-18T12:56:14.161 INFO:teuthology.orchestra.run.smithi176.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-18T12:56:14.181 INFO:teuthology.orchestra.run.smithi120.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-18T12:56:14.211 INFO:teuthology.orchestra.run.smithi176.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-18T12:56:14.437 INFO:teuthology.orchestra.run.smithi176.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.9 MB/s | 3.0 MB 00:00 2024-09-18T12:56:14.545 INFO:teuthology.orchestra.run.smithi176.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-18T12:56:14.570 INFO:teuthology.orchestra.run.smithi176.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-18T12:56:14.622 INFO:teuthology.orchestra.run.smithi120.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.4 MB/s | 3.0 MB 00:00 2024-09-18T12:56:14.638 INFO:teuthology.orchestra.run.smithi176.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-09-18T12:56:14.771 INFO:teuthology.orchestra.run.smithi176.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-18T12:56:14.973 INFO:teuthology.orchestra.run.smithi120.stdout:(7/12): ceph-mgr-diskprediction-local-19.3.0-49 5.9 MB/s | 7.4 MB 00:01 2024-09-18T12:56:14.998 INFO:teuthology.orchestra.run.smithi120.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 652 kB/s | 245 kB 00:00 2024-09-18T12:56:15.123 INFO:teuthology.orchestra.run.smithi120.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-18T12:56:15.180 INFO:teuthology.orchestra.run.smithi176.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-18T12:56:15.397 INFO:teuthology.orchestra.run.smithi176.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 4.6 MB/s | 7.4 MB 00:01 2024-09-18T12:56:15.397 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:15.398 INFO:teuthology.orchestra.run.smithi176.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-18T12:56:15.590 INFO:teuthology.orchestra.run.smithi120.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.5 MB/s | 4.9 MB 00:01 2024-09-18T12:56:15.756 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:15.782 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:15.782 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:16.210 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:16.211 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:16.532 INFO:teuthology.orchestra.run.smithi120.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-09-18T12:56:16.985 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:17.045 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:56:17.086 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:56:17.184 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:56:17.221 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:56:17.404 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:56:17.436 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:56:17.512 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:56:18.049 INFO:teuthology.orchestra.run.smithi120.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-18T12:56:18.050 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:18.050 INFO:teuthology.orchestra.run.smithi120.stdout:Total 8.6 MB/s | 38 MB 00:04 2024-09-18T12:56:18.154 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:56:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:56:18.405 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:18.431 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:18.431 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:18.870 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:18.870 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:19.520 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:56:19.624 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:19.695 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:56:19.730 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:56:19.834 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:56:19.882 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:56:20.065 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:56:20.097 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:56:20.173 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:56:20.564 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:56:20.594 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 12/12 2024-09-18T12:56:20.814 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:56:20.935 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:56:22.153 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:56:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 12/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 1/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:56:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:56:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:56:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:56:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:56:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:56:23.224 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 12/12 2024-09-18T12:56:23.597 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:56:23.597 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:23.597 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:56:23.598 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:23.599 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:24.053 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:56:24.645 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:46 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 49 k 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:56:24.781 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout:Install 13 Packages 2024-09-18T12:56:24.782 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:24.783 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 2.2 M 2024-09-18T12:56:24.783 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 26 M 2024-09-18T12:56:24.783 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:25.052 INFO:teuthology.orchestra.run.smithi176.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 321 kB/s | 26 kB 00:00 2024-09-18T12:56:25.077 INFO:teuthology.orchestra.run.smithi176.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 183 kB/s | 19 kB 00:00 2024-09-18T12:56:25.136 INFO:teuthology.orchestra.run.smithi176.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-18T12:56:25.161 INFO:teuthology.orchestra.run.smithi176.stdout:(4/13): ceph-mgr-rook-19.3.0-4931.g090e6509.el9 261 kB/s | 49 kB 00:00 2024-09-18T12:56:25.189 INFO:teuthology.orchestra.run.smithi176.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-18T12:56:25.211 INFO:teuthology.orchestra.run.smithi176.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-09-18T12:56:25.253 INFO:teuthology.orchestra.run.smithi176.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-18T12:56:25.279 INFO:teuthology.orchestra.run.smithi176.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 456 kB/s | 54 kB 00:00 2024-09-18T12:56:25.329 INFO:teuthology.orchestra.run.smithi176.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 127 kB/s | 14 kB 00:00 2024-09-18T12:56:25.363 INFO:teuthology.orchestra.run.smithi176.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-18T12:56:25.388 INFO:teuthology.orchestra.run.smithi176.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-18T12:56:25.413 INFO:teuthology.orchestra.run.smithi176.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-18T12:56:25.463 INFO:teuthology.orchestra.run.smithi176.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.5 MB/s | 1.0 MB 00:00 2024-09-18T12:56:25.466 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:25.466 INFO:teuthology.orchestra.run.smithi176.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-18T12:56:25.527 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:25.542 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:25.542 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:25.631 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:25.635 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 12/12 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6 1/12 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:56:25.827 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:56:25.828 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:56:25.828 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:56:25.828 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:56:25.828 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:56:26.141 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:56:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:26.230 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:26.231 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:26.324 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:56:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:56:26.436 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:56:26.474 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:56:26.515 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:56:26.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:56:26.617 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:56:26.719 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:56:26.775 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:56:27.177 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:51 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:27.309 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 49 k 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:56:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout:Install 13 Packages 2024-09-18T12:56:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:27.313 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 2.2 M 2024-09-18T12:56:27.313 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 26 M 2024-09-18T12:56:27.313 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:27.487 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:56:27.539 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:56:27.573 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:56:27.619 INFO:teuthology.orchestra.run.smithi120.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 274 kB/s | 26 kB 00:00 2024-09-18T12:56:27.620 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:56:27.642 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 13/13 2024-09-18T12:56:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 161 kB/s | 19 kB 00:00 2024-09-18T12:56:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:(3/13): ceph-mgr-rook-19.3.0-4931.g090e6509.el9 278 kB/s | 49 kB 00:00 2024-09-18T12:56:27.728 INFO:teuthology.orchestra.run.smithi120.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-18T12:56:27.778 INFO:teuthology.orchestra.run.smithi120.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-18T12:56:27.804 INFO:teuthology.orchestra.run.smithi120.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 715 kB/s | 54 kB 00:00 2024-09-18T12:56:27.879 INFO:teuthology.orchestra.run.smithi120.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 321 kB/s | 32 kB 00:00 2024-09-18T12:56:27.904 INFO:teuthology.orchestra.run.smithi120.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-18T12:56:27.930 INFO:teuthology.orchestra.run.smithi120.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 119 kB/s | 14 kB 00:00 2024-09-18T12:56:27.963 INFO:teuthology.orchestra.run.smithi120.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-18T12:56:27.989 INFO:teuthology.orchestra.run.smithi120.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-18T12:56:28.013 INFO:teuthology.orchestra.run.smithi120.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-18T12:56:28.106 INFO:teuthology.orchestra.run.smithi120.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-09-18T12:56:28.108 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:28.108 INFO:teuthology.orchestra.run.smithi120.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-09-18T12:56:28.172 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:28.187 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:28.187 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:28.275 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:28.276 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 13/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 1/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:56:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:56:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:56:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:56:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:56:28.783 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:56:28.787 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:28.788 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:56:29.032 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:56:29.063 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:56:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:56:29.133 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:56:29.174 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:56:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:56:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:56:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:56:29.648 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:51 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:29.782 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:29.782 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:29.782 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 154 k 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout:Install 6 Packages 2024-09-18T12:56:29.783 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:29.784 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 7.0 M 2024-09-18T12:56:29.784 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 33 M 2024-09-18T12:56:29.784 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:30.150 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:56:30.217 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:56:30.250 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:56:30.291 INFO:teuthology.orchestra.run.smithi176.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4931.g090e6509.e 715 kB/s | 154 kB 00:00 2024-09-18T12:56:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:56:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 13/13 2024-09-18T12:56:30.366 INFO:teuthology.orchestra.run.smithi176.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.7 MB/s | 548 kB 00:00 2024-09-18T12:56:30.399 INFO:teuthology.orchestra.run.smithi176.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-18T12:56:30.425 INFO:teuthology.orchestra.run.smithi176.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-18T12:56:30.866 INFO:teuthology.orchestra.run.smithi176.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 313 kB/s | 248 kB 00:00 2024-09-18T12:56:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 13/13 2024-09-18T12:56:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 1/13 2024-09-18T12:56:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:56:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:56:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:56:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:56:31.242 INFO:teuthology.orchestra.run.smithi176.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-18T12:56:31.244 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:31.244 INFO:teuthology.orchestra.run.smithi176.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-18T12:56:31.317 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:31.333 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:31.333 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:56:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:31.420 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:56:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:31.421 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:31.429 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:31.429 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:31.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:56:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:56:31.968 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:56:32.251 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:56 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:32.385 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:32.385 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 154 k 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:32.386 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:32.387 INFO:teuthology.orchestra.run.smithi120.stdout:Install 6 Packages 2024-09-18T12:56:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:32.387 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 7.0 M 2024-09-18T12:56:32.387 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 33 M 2024-09-18T12:56:32.387 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:32.497 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:56:32.588 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:56:32.656 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:56:32.660 INFO:teuthology.orchestra.run.smithi120.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-18T12:56:32.681 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 6/6 2024-09-18T12:56:32.694 INFO:teuthology.orchestra.run.smithi120.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4931.g090e6509.e 770 kB/s | 154 kB 00:00 2024-09-18T12:56:32.736 INFO:teuthology.orchestra.run.smithi120.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-18T12:56:32.761 INFO:teuthology.orchestra.run.smithi120.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-18T12:56:32.787 INFO:teuthology.orchestra.run.smithi120.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 636 kB/s | 58 kB 00:00 2024-09-18T12:56:32.887 INFO:teuthology.orchestra.run.smithi120.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-18T12:56:32.889 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:32.889 INFO:teuthology.orchestra.run.smithi120.stdout:Total 14 MB/s | 7.0 MB 00:00 2024-09-18T12:56:32.959 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:32.971 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:32.971 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:33.070 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:33.070 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:33.385 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:33.472 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 6/6 2024-09-18T12:56:33.472 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/6 2024-09-18T12:56:33.473 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:56:33.473 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:56:33.473 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:56:33.473 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:56:33.559 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:56:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:56:33.769 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:56:33.769 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:33.769 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:33.769 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:33.769 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:56:33.769 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:56:33.769 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:56:33.770 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:56:33.770 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:56:33.770 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:33.770 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:34.042 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-fuse 2024-09-18T12:56:34.142 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:56:34.224 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:56:34.294 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:56:34.318 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 6/6 2024-09-18T12:56:34.625 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:56 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:34.759 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:34.759 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 884 k 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout:Install 2 Packages 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:34.760 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 963 k 2024-09-18T12:56:34.761 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 4.1 M 2024-09-18T12:56:34.761 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:35.043 INFO:teuthology.orchestra.run.smithi176.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-09-18T12:56:35.161 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 6/6 2024-09-18T12:56:35.161 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 1/6 2024-09-18T12:56:35.161 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:56:35.161 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:56:35.161 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:56:35.161 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:56:35.202 INFO:teuthology.orchestra.run.smithi176.stdout:(2/2): ceph-fuse-19.3.0-4931.g090e6509.el9.x86_ 3.0 MB/s | 884 kB 00:00 2024-09-18T12:56:35.202 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:35.203 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.1 MB/s | 963 kB 00:00 2024-09-18T12:56:35.214 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:35.238 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:35.238 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:35.319 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:35.319 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:35.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:56:35.453 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:35.453 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:35.453 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:35.453 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:56:35.453 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:56:35.454 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:56:35.454 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:56:35.454 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:56:35.454 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:35.454 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:35.502 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:56:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2/2 2024-09-18T12:56:35.726 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-fuse 2024-09-18T12:56:36.304 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:00 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:36.417 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2/2 2024-09-18T12:56:36.417 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/2 2024-09-18T12:56:36.436 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 884 k 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:36.437 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:36.438 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:36.438 INFO:teuthology.orchestra.run.smithi120.stdout:Install 2 Packages 2024-09-18T12:56:36.438 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:36.438 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 963 k 2024-09-18T12:56:36.438 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 4.1 M 2024-09-18T12:56:36.438 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:56:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:36.679 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:56:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:36.679 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:36.757 INFO:teuthology.orchestra.run.smithi120.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 445 kB/s | 80 kB 00:00 2024-09-18T12:56:36.898 INFO:teuthology.orchestra.run.smithi120.stdout:(2/2): ceph-fuse-19.3.0-4931.g090e6509.el9.x86_ 2.7 MB/s | 884 kB 00:00 2024-09-18T12:56:36.899 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:36.899 INFO:teuthology.orchestra.run.smithi120.stdout:Total 2.0 MB/s | 963 kB 00:00 2024-09-18T12:56:36.911 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:36.935 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:36.935 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:36.965 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-volume 2024-09-18T12:56:37.016 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:37.016 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:37.377 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:56:37.439 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2/2 2024-09-18T12:56:37.548 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:59 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:37.683 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 285 k 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:56:37.684 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:37.685 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 285 k 2024-09-18T12:56:37.685 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 1.3 M 2024-09-18T12:56:37.685 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:37.907 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-volume-19.3.0-4931.g090e6509.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-18T12:56:37.907 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:37.907 INFO:teuthology.orchestra.run.smithi176.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T12:56:37.907 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:37.916 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:37.916 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:37.941 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:37.941 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:38.082 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2/2 2024-09-18T12:56:38.082 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/2 2024-09-18T12:56:38.159 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:38.225 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:38.241 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:38.241 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:38.241 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T12:56:38.241 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:38.354 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:56:38.354 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:38.354 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:38.354 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:56:38.354 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:38.354 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:38.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-volume 2024-09-18T12:56:39.225 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:39.226 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:39.226 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:39.226 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:39.226 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:39.226 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:39.247 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:03 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:39.380 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:39.381 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-18T12:56:39.381 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:39.381 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.3.0-4931.g090e6509.el9 ceph-noarch 285 k 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 285 k 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 1.3 M 2024-09-18T12:56:39.382 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:39.538 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librados-devel 2024-09-18T12:56:39.604 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-volume-19.3.0-4931.g090e6509.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-18T12:56:39.605 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:39.605 INFO:teuthology.orchestra.run.smithi120.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T12:56:39.605 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:39.614 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:39.614 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:39.643 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:39.644 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:39.862 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:39.948 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:39.948 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T12:56:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:40.140 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:02 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:40.271 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.3.0-4931.g090e6509.el9 ceph 125 k 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:56:40.272 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:40.273 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 125 k 2024-09-18T12:56:40.273 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 445 k 2024-09-18T12:56:40.273 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:40.478 INFO:teuthology.orchestra.run.smithi176.stdout:librados-devel-19.3.0-4931.g090e6509.el9.x86_64 607 kB/s | 125 kB 00:00 2024-09-18T12:56:40.479 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:40.479 INFO:teuthology.orchestra.run.smithi176.stdout:Total 603 kB/s | 125 kB 00:00 2024-09-18T12:56:40.479 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:40.485 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:40.485 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:40.548 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:40.548 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:40.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 1/1 2024-09-18T12:56:40.911 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:40.911 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:40.911 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.3.0-4931.g090e6509.el9.noarch 2024-09-18T12:56:40.911 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:40.911 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:41.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados-devel 2024-09-18T12:56:41.273 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:41.527 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:41.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:41.527 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:41.527 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:41.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:41.527 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:41.770 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs2 2024-09-18T12:56:41.779 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:05 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:41.917 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:41.918 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:41.919 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-18T12:56:41.919 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:41.919 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:41.919 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.3.0-4931.g090e6509.el9 ceph 125 k 2024-09-18T12:56:41.919 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:41.919 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:41.920 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:41.920 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:56:41.920 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:41.920 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 125 k 2024-09-18T12:56:41.920 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 445 k 2024-09-18T12:56:41.920 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:42.136 INFO:teuthology.orchestra.run.smithi120.stdout:librados-devel-19.3.0-4931.g090e6509.el9.x86_64 576 kB/s | 125 kB 00:00 2024-09-18T12:56:42.137 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:42.137 INFO:teuthology.orchestra.run.smithi120.stdout:Total 572 kB/s | 125 kB 00:00 2024-09-18T12:56:42.137 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:42.142 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:42.142 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:42.205 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:42.205 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:42.351 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:42.364 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:04 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:42.456 INFO:teuthology.orchestra.run.smithi176.stdout:Package libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:42.459 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:42.500 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:42.501 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:42.501 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:42.587 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs-devel 2024-09-18T12:56:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:43.145 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:43.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:43.145 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:43.145 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:43.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:43.145 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:43.167 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:05 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:43.300 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.3.0-4931.g090e6509.el9 ceph 32 k 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:43.301 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:56:43.302 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:43.302 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 32 k 2024-09-18T12:56:43.302 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 142 k 2024-09-18T12:56:43.302 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:43.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs2 2024-09-18T12:56:43.456 INFO:teuthology.orchestra.run.smithi176.stdout:libcephfs-devel-19.3.0-4931.g090e6509.el9.x86_6 205 kB/s | 32 kB 00:00 2024-09-18T12:56:43.457 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:43.457 INFO:teuthology.orchestra.run.smithi176.stdout:Total 203 kB/s | 32 kB 00:00 2024-09-18T12:56:43.457 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:43.461 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:43.461 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:43.482 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:43.483 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:43.574 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:43.687 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:43.984 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:07 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:44.063 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:Package libcephfs2-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:44.117 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:44.118 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:44.118 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:44.218 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs-devel 2024-09-18T12:56:44.290 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:44.290 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:44.290 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:44.290 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:44.290 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:44.290 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:44.463 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librados2 2024-09-18T12:56:44.793 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:08 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:44.925 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.3.0-4931.g090e6509.el9 ceph 32 k 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:44.926 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:56:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:44.927 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 32 k 2024-09-18T12:56:44.927 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 142 k 2024-09-18T12:56:44.927 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:45.039 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:07 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:45.082 INFO:teuthology.orchestra.run.smithi120.stdout:libcephfs-devel-19.3.0-4931.g090e6509.el9.x86_6 205 kB/s | 32 kB 00:00 2024-09-18T12:56:45.082 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:45.083 INFO:teuthology.orchestra.run.smithi120.stdout:Total 203 kB/s | 32 kB 00:00 2024-09-18T12:56:45.083 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:45.086 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:45.086 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:45.110 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:45.110 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:45.127 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:45.171 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:45.172 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:45.172 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:45.200 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:45.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librbd1 2024-09-18T12:56:45.312 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:45.703 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:45.818 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:07 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:45.908 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:45.934 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:45.934 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:45.935 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:45.935 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:45.935 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:45.935 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:45.951 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:45.952 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:45.952 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:46.023 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rados 2024-09-18T12:56:46.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados2 2024-09-18T12:56:46.605 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:08 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:46.698 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:46.701 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:10 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:46.743 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:46.744 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:46.744 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:46.792 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:46.816 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rgw 2024-09-18T12:56:46.835 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:46.836 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:46.836 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:46.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librbd1 2024-09-18T12:56:47.398 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:09 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:47.489 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:47.496 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:11 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:47.533 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:47.534 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:47.534 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:47.586 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:47.609 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-cephfs 2024-09-18T12:56:47.629 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:47.630 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:47.630 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:47.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rados 2024-09-18T12:56:48.187 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:10 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:48.277 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:48.283 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:12 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:48.320 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:48.321 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:48.321 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:48.374 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rados-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:48.398 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rbd 2024-09-18T12:56:48.418 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:48.419 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:48.419 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:48.498 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rgw 2024-09-18T12:56:48.972 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:10 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:49.063 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:49.076 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:13 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:49.108 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-18T12:56:49.108 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:49.166 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rgw-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:49.181 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-fuse 2024-09-18T12:56:49.210 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:49.211 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:49.211 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:49.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-cephfs 2024-09-18T12:56:49.766 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:11 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:49.873 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:13 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:49.900 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:49.900 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:49.900 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-18T12:56:49.901 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:49.901 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:49.901 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 91 k 2024-09-18T12:56:49.901 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:49.901 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:49.901 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:49.901 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:56:49.902 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:49.902 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 91 k 2024-09-18T12:56:49.902 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 321 k 2024-09-18T12:56:49.902 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:49.961 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-cephfs-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:50.005 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:50.006 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:50.006 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:50.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rbd 2024-09-18T12:56:50.101 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-fuse-19.3.0-4931.g090e6509.el9.x86_64.rpm 453 kB/s | 91 kB 00:00 2024-09-18T12:56:50.101 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:50.102 INFO:teuthology.orchestra.run.smithi176.stdout:Total 450 kB/s | 91 kB 00:00 2024-09-18T12:56:50.102 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:50.110 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:50.110 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:50.173 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:50.174 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:50.327 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:50.423 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:50.656 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:14 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:50.746 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rbd-2:19.3.0-4931.g090e6509.el9.x86_64 is already installed. 2024-09-18T12:56:50.790 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:50.791 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-18T12:56:50.791 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:50.833 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:50.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-fuse 2024-09-18T12:56:51.091 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:51.091 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:51.091 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:51.091 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:51.091 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:51.092 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:51.405 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-mirror 2024-09-18T12:56:51.449 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:15 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:51.581 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.3.0-4931.g090e6509.el9 ceph 91 k 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:56:51.585 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:51.585 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 91 k 2024-09-18T12:56:51.585 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 321 k 2024-09-18T12:56:51.585 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:51.768 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-fuse-19.3.0-4931.g090e6509.el9.x86_64.rpm 488 kB/s | 91 kB 00:00 2024-09-18T12:56:51.769 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:51.769 INFO:teuthology.orchestra.run.smithi120.stdout:Total 485 kB/s | 91 kB 00:00 2024-09-18T12:56:51.769 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:51.778 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:51.841 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:51.842 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:51.988 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:13 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:51.997 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:52.107 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:52.122 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:52.122 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.5 M 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 3.5 M 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 30 M 2024-09-18T12:56:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:52.446 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-mirror-19.3.0-4931.g090e6509.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-09-18T12:56:52.447 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:52.447 INFO:teuthology.orchestra.run.smithi176.stdout:Total 11 MB/s | 3.5 MB 00:00 2024-09-18T12:56:52.447 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:52.458 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:52.458 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:52.541 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:52.544 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:52.708 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:52.709 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:52.709 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:52.709 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:52.709 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:52.709 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:52.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-mirror 2024-09-18T12:56:53.126 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:53.205 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:53.230 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:53.230 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:53.230 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:56:53.230 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:56:53.230 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:56:53.230 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:53.590 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:17 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:53.732 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.3.0-4931.g090e6509.el9 ceph 3.5 M 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:56:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:53.734 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 3.5 M 2024-09-18T12:56:53.734 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 30 M 2024-09-18T12:56:53.734 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:54.090 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-mirror-19.3.0-4931.g090e6509.el9.x86_64.rpm 9.9 MB/s | 3.5 MB 00:00 2024-09-18T12:56:54.090 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:54.091 INFO:teuthology.orchestra.run.smithi120.stdout:Total 9.8 MB/s | 3.5 MB 00:00 2024-09-18T12:56:54.091 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:54.102 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:54.102 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:54.187 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:54.187 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:54.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:54.498 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:54.498 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:54.498 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:54.498 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:54.498 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:54.758 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-nbd 2024-09-18T12:56:54.789 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:54.849 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:54.875 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:54.920 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:56:54.920 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:56:54.920 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:56:54.920 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:56:54.921 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:55.349 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:02:17 ago on Wed 18 Sep 2024 12:54:38 PM UTC. 2024-09-18T12:56:55.482 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-18T12:56:55.483 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:55.483 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-18T12:56:55.483 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:55.483 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-18T12:56:55.483 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 177 k 2024-09-18T12:56:55.483 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:55.484 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-18T12:56:55.484 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-18T12:56:55.484 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-18T12:56:55.484 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:55.484 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 177 k 2024-09-18T12:56:55.484 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 685 k 2024-09-18T12:56:55.484 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-18T12:56:55.690 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-nbd-19.3.0-4931.g090e6509.el9.x86_64.rpm 857 kB/s | 177 kB 00:00 2024-09-18T12:56:55.691 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:55.691 INFO:teuthology.orchestra.run.smithi176.stdout:Total 850 kB/s | 177 kB 00:00 2024-09-18T12:56:55.691 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-18T12:56:55.701 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-18T12:56:55.701 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-18T12:56:55.765 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-18T12:56:55.765 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-18T12:56:55.921 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-18T12:56:56.013 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:56.174 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:56.175 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:56.435 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-nbd 2024-09-18T12:56:56.440 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:56.682 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-18T12:56:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:56:56.682 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-18T12:56:56.943 DEBUG:teuthology.parallel:result is None 2024-09-18T12:56:57.034 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:21 ago on Wed 18 Sep 2024 12:54:36 PM UTC. 2024-09-18T12:56:57.168 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.3.0-4931.g090e6509.el9 ceph 177 k 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:57.169 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 177 k 2024-09-18T12:56:57.170 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 685 k 2024-09-18T12:56:57.170 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-18T12:56:57.378 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-nbd-19.3.0-4931.g090e6509.el9.x86_64.rpm 848 kB/s | 177 kB 00:00 2024-09-18T12:56:57.378 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:56:57.378 INFO:teuthology.orchestra.run.smithi120.stdout:Total 843 kB/s | 177 kB 00:00 2024-09-18T12:56:57.379 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-18T12:56:57.388 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-18T12:56:57.388 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-18T12:56:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-18T12:56:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-18T12:56:57.606 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-18T12:56:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:58.093 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 1/1 2024-09-18T12:56:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:58.333 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-18T12:56:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.3.0-4931.g090e6509.el9.x86_64 2024-09-18T12:56:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:56:58.333 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-18T12:56:58.586 DEBUG:teuthology.parallel:result is None 2024-09-18T12:56:58.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:56:58.757 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:56:58.779 INFO:teuthology.orchestra.run.smithi120.stdout:19.3.0-4931.g090e6509.el9 2024-09-18T12:56:58.780 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4931.g090e6509.el9 2024-09-18T12:56:58.780 INFO:teuthology.task.install:The correct ceph version 19.3.0-4931.g090e6509 is installed. 2024-09-18T12:56:58.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=090e6509f8ae300193b1735deab951d46056ec88 2024-09-18T12:56:58.924 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:56:58.949 INFO:teuthology.orchestra.run.smithi176.stdout:19.3.0-4931.g090e6509.el9 2024-09-18T12:56:58.949 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4931.g090e6509.el9 2024-09-18T12:56:58.950 INFO:teuthology.task.install:The correct ceph version 19.3.0-4931.g090e6509 is installed. 2024-09-18T12:56:58.951 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T12:56:58.952 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:56:58.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:56:58.977 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:56:58.977 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:56:59.021 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T12:56:59.021 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:56:59.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:56:59.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:56:59.110 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:56:59.110 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:56:59.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:56:59.206 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T12:56:59.207 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:56:59.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:56:59.231 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:56:59.296 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:56:59.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:56:59.324 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:56:59.390 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T12:56:59.390 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:56:59.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:56:59.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:56:59.480 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:56:59.480 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:56:59.505 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:56:59.570 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T12:56:59.656 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T12:56:59.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-18T12:56:59.659 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-09-18T12:56:59.683 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T12:56:59.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T12:56:59.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T12:56:59.749 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T12:56:59.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T12:56:59.788 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T12:56:59.823 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T12:56:59.823 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T12:56:59.824 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396', 'branch': 'main', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7911396', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '090e6509f8ae300193b1735deab951d46056ec88'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_nmordech@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2042, 'sha1': '090e6509f8ae300193b1735deab951d46056ec88', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFPkbgjxcZFBQ9o8aztzszdkw7v6wOZeXhsYU4sQLfbPu9YfuO084G7/5IhYty4YMs9E2gVG81T/aOQGBp3Iqo=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGet1XAEr+xJUg2gPZoPLsdKHybip7XhGDF9+yswzeHDBEdwCWDndURxv+KZxj1+6k8vBveS0W1cJoihBufp/mg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '090e6509f8ae300193b1735deab951d46056ec88', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_12:39:24', 'tube': 'smithi', 'user': 'nmordech', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T12:56:59.824 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T12:56:59.853 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T12:56:59.870 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T12:56:59.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T12:56:59.935 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:56:59.935 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:56:59.988 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:56:59.989 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-18 12:56:55.154812032 +0000 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-18 12:53:54.935403371 +0000 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-18 12:53:54.935403371 +0000 2024-09-18T12:57:00.044 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-18 12:53:54.935403371 +0000 2024-09-18T12:57:00.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:57:00.107 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-18T12:57:00.107 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-18T12:57:00.107 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000212986 s, 2.4 MB/s 2024-09-18T12:57:00.109 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:57:00.165 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-18 12:56:55.155812010 +0000 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-18 12:53:55.265395973 +0000 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-18 12:53:55.265395973 +0000 2024-09-18T12:57:00.220 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-18 12:53:55.265395973 +0000 2024-09-18T12:57:00.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:57:00.282 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-18T12:57:00.283 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-18T12:57:00.283 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000203533 s, 2.5 MB/s 2024-09-18T12:57:00.284 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:57:00.340 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-18 12:56:55.155812010 +0000 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-18 12:53:55.609388261 +0000 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-18 12:53:55.609388261 +0000 2024-09-18T12:57:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-18 12:53:55.609388261 +0000 2024-09-18T12:57:00.396 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:57:00.457 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-18T12:57:00.458 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-18T12:57:00.458 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00019277 s, 2.7 MB/s 2024-09-18T12:57:00.459 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:57:00.515 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-18T12:57:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:57:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:00.570 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T12:57:00.570 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:00.570 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:00.570 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-18 12:56:55.155812010 +0000 2024-09-18T12:57:00.571 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-18 12:53:55.925381176 +0000 2024-09-18T12:57:00.571 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-18 12:53:55.925381176 +0000 2024-09-18T12:57:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-18 12:53:55.925381176 +0000 2024-09-18T12:57:00.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:57:00.633 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-18T12:57:00.633 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-18T12:57:00.633 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000171081 s, 3.0 MB/s 2024-09-18T12:57:00.634 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:57:00.689 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-18T12:57:00.689 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:00.689 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:57:00.705 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:57:00.706 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-18 12:56:53.498657471 +0000 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-18 12:53:54.946704205 +0000 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-18 12:53:54.946704205 +0000 2024-09-18T12:57:00.761 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-18 12:53:54.946704205 +0000 2024-09-18T12:57:00.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:57:00.824 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-18T12:57:00.825 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-18T12:57:00.825 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000208607 s, 2.5 MB/s 2024-09-18T12:57:00.826 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:57:00.882 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-18T12:57:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:57:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:00.939 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-18T12:57:00.939 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:00.939 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:00.939 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-18 12:56:53.498657471 +0000 2024-09-18T12:57:00.940 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-18 12:53:55.266701557 +0000 2024-09-18T12:57:00.940 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-18 12:53:55.266701557 +0000 2024-09-18T12:57:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-18 12:53:55.266701557 +0000 2024-09-18T12:57:00.940 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:57:01.002 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-18T12:57:01.002 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-18T12:57:01.002 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000223558 s, 2.3 MB/s 2024-09-18T12:57:01.003 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:57:01.060 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-18T12:57:01.116 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:57:01.116 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:01.116 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-18T12:57:01.116 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:01.116 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:01.117 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-18 12:56:53.499657462 +0000 2024-09-18T12:57:01.117 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-18 12:53:55.626698578 +0000 2024-09-18T12:57:01.117 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-18 12:53:55.626698578 +0000 2024-09-18T12:57:01.117 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-18 12:53:55.626698578 +0000 2024-09-18T12:57:01.117 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:57:01.179 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-18T12:57:01.179 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-18T12:57:01.179 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000166391 s, 3.1 MB/s 2024-09-18T12:57:01.180 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:57:01.235 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-18 12:56:53.499657462 +0000 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-18 12:53:55.963695789 +0000 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-18 12:53:55.963695789 +0000 2024-09-18T12:57:01.291 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-18 12:53:55.963695789 +0000 2024-09-18T12:57:01.292 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:57:01.354 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-18T12:57:01.354 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-18T12:57:01.354 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000178223 s, 2.9 MB/s 2024-09-18T12:57:01.355 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:57:01.412 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-18T12:57:01.412 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-18T12:57:01.412 INFO:tasks.ceph:Generating config... 2024-09-18T12:57:01.413 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-18T12:57:01.414 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-18T12:57:01.414 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-18T12:57:01.414 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T12:57:01.414 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-18T12:57:01.414 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-18T12:57:01.414 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] log to file = False 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T12:57:01.415 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T12:57:01.416 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-18T12:57:01.416 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-18T12:57:01.416 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-18T12:57:01.416 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T12:57:01.416 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T12:57:01.416 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-18T12:57:01.416 INFO:tasks.ceph:[client] debug ms = 1 2024-09-18T12:57:01.416 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-18T12:57:01.416 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-18T12:57:01.416 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-18T12:57:01.416 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-18T12:57:01.416 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-18T12:57:01.416 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-18T12:57:01.416 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-18T12:57:01.417 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T12:57:01.417 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T12:57:01.417 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-18T12:57:01.417 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-18T12:57:01.417 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-18T12:57:01.417 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-18T12:57:01.417 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-18T12:57:01.417 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T12:57:01.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T12:57:01.477 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T12:57:01.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T12:57:01.533 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T12:57:01.558 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120')] 2024-09-18T12:57:01.558 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-18T12:57:01.560 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:01.560 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T12:57:01.614 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:01.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:01.705+0000 7fabe7639f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:01.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:01.705+0000 7fabe7639f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:01.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:01.705+0000 7fabe7639f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:01.707 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:01.707 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid 663d1a24-c7eb-48da-8c03-7f80c4504c0c 2024-09-18T12:57:01.707 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = quincy 2024-09-18T12:57:01.707 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2024-09-18T12:57:01.707 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 663d1a24-c7eb-48da-8c03-7f80c4504c0c 2024-09-18T12:57:01.707 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2024-09-18T12:57:01.706765+0000 2024-09-18T12:57:01.707 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-09-18T12:57:01.706765+0000 2024-09-18T12:57:01.708 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 17 (quincy) 2024-09-18T12:57:01.708 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2024-09-18T12:57:01.708 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-18T12:57:01.708 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-18T12:57:01.709 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T12:57:01.724 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 663d1a24-c7eb-48da-8c03-7f80c4504c0c... 2024-09-18T12:57:01.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T12:57:01.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T12:57:01.806 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-18T12:57:01.806 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-18T12:57:01.807 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-18T12:57:01.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T12:57:01.809 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = 172.21.15.120 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: ms client mode = crc 2024-09-18T12:57:01.810 INFO:teuthology.orchestra.run.smithi120.stdout: ms cluster mode = crc 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: ms mon client mode = crc 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: ms mon cluster mode = crc 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: ms mon service mode = crc 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: ms service mode = crc 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 663d1a24-c7eb-48da-8c03-7f80c4504c0c 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-18T12:57:01.811 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.812 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-18T12:57:01.813 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.813 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-18T12:57:01.813 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.813 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-18T12:57:01.816 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.816 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-18T12:57:01.816 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-18T12:57:01.816 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.816 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-18T12:57:01.816 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: debug monc = 20 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore compression algorithm = snappy 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore compression mode = aggressive 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore rocksdb cf = False 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: crimson alien thread cpu cores = 6-7 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: crimson osd obc lru size = 10 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 20 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 20 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 10 2024-09-18T12:57:01.817 INFO:teuthology.orchestra.run.smithi120.stdout: err to stderr = True 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: log flush on exit = True 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: log to file = False 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: log to stderr = True 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: osd blocked scrub grace period = 3600 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: osd class default list = * 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: osd class load list = * 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: osd shutdown pgref assert = True 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-18T12:57:01.818 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mgr stats period = 30 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:57:01.819 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.820 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: mon min osdmap epochs = 50 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: mon osdmap full prune interval = 2 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: mon osdmap full prune min = 15 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: mon osdmap full prune txsize = 2 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: paxos service trim min = 10 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on pool no app = False 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default crimson = True 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T12:57:01.821 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout: crimson seastar cpu cores = 0-2 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout: crimson seastar cpu cores = 3-5 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout: crimson seastar cpu cores = 0-2 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-09-18T12:57:01.822 INFO:teuthology.orchestra.run.smithi120.stdout: crimson seastar cpu cores = 3-5 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-18T12:57:01.824 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.825 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-18T12:57:01.826 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = 172.21.15.120 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: ms client mode = crc 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: ms cluster mode = crc 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: ms mon client mode = crc 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: ms mon cluster mode = crc 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: ms mon service mode = crc 2024-09-18T12:57:01.827 INFO:teuthology.orchestra.run.smithi176.stdout: ms service mode = crc 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 663d1a24-c7eb-48da-8c03-7f80c4504c0c 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-18T12:57:01.828 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-18T12:57:01.829 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: debug monc = 20 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore compression algorithm = snappy 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore compression mode = aggressive 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore rocksdb cf = False 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: crimson alien thread cpu cores = 6-7 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: crimson osd obc lru size = 10 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2024-09-18T12:57:01.830 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: err to stderr = True 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: log flush on exit = True 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: log to file = False 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: log to stderr = True 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: osd blocked scrub grace period = 3600 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: osd class default list = * 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: osd class load list = * 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-18T12:57:01.831 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: osd shutdown pgref assert = True 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: mgr stats period = 30 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-18T12:57:01.832 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-18T12:57:01.833 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-18T12:57:01.833 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-18T12:57:01.833 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T12:57:01.834 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon min osdmap epochs = 50 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon osdmap full prune interval = 2 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon osdmap full prune min = 15 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon osdmap full prune txsize = 2 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: paxos service trim min = 10 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on pool no app = False 2024-09-18T12:57:01.835 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default crimson = True 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 0-2 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-09-18T12:57:01.836 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 3-5 2024-09-18T12:57:01.837 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-09-18T12:57:01.837 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 0-2 2024-09-18T12:57:01.837 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-09-18T12:57:01.837 INFO:teuthology.orchestra.run.smithi176.stdout: crimson seastar cpu cores = 3-5 2024-09-18T12:57:01.837 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T12:57:01.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T12:57:01.928 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T12:57:01.929 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:01.929 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T12:57:01.944 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:01.944 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T12:57:01.999 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-18T12:57:01.999 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:01.999 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T12:57:02.000 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T12:57:02.073 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:02.073 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:02.128 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-09-18T12:57:02.128 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:02.128 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T12:57:02.128 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T12:57:02.163 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:02.163 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:02.218 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T12:57:02.218 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T12:57:02.218 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T12:57:02.329 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T12:57:02.332 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T12:57:02.332 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T12:57:02.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T12:57:02.383 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T12:57:02.396 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-18T12:57:02.446 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-18T12:57:02.460 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T12:57:02.460 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-18T12:57:02.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:02.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-18T12:57:02.486 INFO:tasks.ceph:role: osd.0 2024-09-18T12:57:02.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-18T12:57:02.486 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T12:57:02.557 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:57:02.558 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:57:02.558 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:57:02.558 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T12:57:02.558 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:57:02.558 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:57:02.558 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:57:02.558 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T12:57:02.559 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:57:02.559 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:57:03.020 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-18T12:57:03.021 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-18T12:57:03.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:03.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:03.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:03.233 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-18T12:57:03.234 INFO:tasks.ceph:role: osd.1 2024-09-18T12:57:03.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-18T12:57:03.234 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T12:57:03.306 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:57:03.307 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:57:03.769 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-18T12:57:03.770 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-18T12:57:03.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:03.843 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:03.911 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:04.211 INFO:teuthology.orchestra.run.smithi120.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:04.211 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:04,211 seastar - Reactor backend: linux-aio 2024-09-18T12:57:04.224 INFO:teuthology.orchestra.run.smithi120.stderr:==28090==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc9da0f 0xbb76399 0xbb77904 0xbb77b1a 0xbb77c70 0xbb78139 0x3e6ef 0x125019 0x421f3 0x3ef7b 0xfd531 0x3621453 0x362165c 0x36302bb 0x38312ca 0x4179f21 0x5fa7624 0x5fa7b7a 0x5def937 0x5e07b79 0x71461d2 0x71579a5 0x7158e42 0x7158ec7 0x7158fc9 0x71590c1 0x71592ce 0x71594b4 0x7159803 0x7159ba7 0x7159dd7 0x715a041 0x715a30e 0x715a52c 0x715a5e4 0x715a6aa 0x715a78b 0x5c52778 0x5c52882 0x5c5293e 0x5c529fa 0x5c52ab6 0x5c52c03 0x5c52d8e 0x5c5314f 0x5c6cf52 0xbb8a947 0xbba27c5 0xbc5006f 0xbc516bd 0xb91ff8d 0xb9207c5 0x3968cb2 0x396a48c 0x380ade2 0x2958f 0x2963f 0x35f29b4 2024-09-18T12:57:04.331 INFO:teuthology.orchestra.run.smithi120.stderr:kernel callstack: 2024-09-18T12:57:04.346 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:04,346 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-18T12:57:04.346 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:04,346 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-18T12:57:04.346 INFO:teuthology.orchestra.run.smithi120.stderr:DEBUG 2024-09-18 12:57:04,347 [shard 0:main] seastar - reactor::drain 2024-09-18T12:57:04.861 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:04.861 INFO:teuthology.orchestra.run.smithi120.stderr:Suppressions used: 2024-09-18T12:57:04.862 INFO:teuthology.orchestra.run.smithi120.stderr: count bytes template 2024-09-18T12:57:04.862 INFO:teuthology.orchestra.run.smithi120.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:04.862 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:04.862 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T12:57:04.916 INFO:teuthology.orchestra.run.smithi120.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:04.920 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:04,920 seastar - Reactor backend: linux-aio 2024-09-18T12:57:04.930 INFO:teuthology.orchestra.run.smithi120.stderr:==28088==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:09.620 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:09.620 INFO:teuthology.orchestra.run.smithi120.stderr:Suppressions used: 2024-09-18T12:57:09.620 INFO:teuthology.orchestra.run.smithi120.stderr: count bytes template 2024-09-18T12:57:09.620 INFO:teuthology.orchestra.run.smithi120.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:09.620 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:09.620 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T12:57:09.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:09.668 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:09.954 INFO:teuthology.orchestra.run.smithi120.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:09.954 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:09,954 seastar - Reactor backend: linux-aio 2024-09-18T12:57:09.960 INFO:teuthology.orchestra.run.smithi120.stderr:==28276==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:10.082 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:10,082 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-18T12:57:10.082 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:10,082 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-18T12:57:10.083 INFO:teuthology.orchestra.run.smithi120.stderr:DEBUG 2024-09-18 12:57:10,083 [shard 0:main] seastar - reactor::drain 2024-09-18T12:57:10.592 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:10.592 INFO:teuthology.orchestra.run.smithi120.stderr:Suppressions used: 2024-09-18T12:57:10.592 INFO:teuthology.orchestra.run.smithi120.stderr: count bytes template 2024-09-18T12:57:10.592 INFO:teuthology.orchestra.run.smithi120.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:10.592 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:10.592 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T12:57:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:10.655 INFO:teuthology.orchestra.run.smithi120.stderr:INFO 2024-09-18 12:57:10,654 seastar - Reactor backend: linux-aio 2024-09-18T12:57:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:==28274==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:15.607 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:15.607 INFO:teuthology.orchestra.run.smithi120.stderr:Suppressions used: 2024-09-18T12:57:15.607 INFO:teuthology.orchestra.run.smithi120.stderr: count bytes template 2024-09-18T12:57:15.607 INFO:teuthology.orchestra.run.smithi120.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:15.607 INFO:teuthology.orchestra.run.smithi120.stderr:----------------------------------------------------- 2024-09-18T12:57:15.607 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T12:57:15.630 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:15.654 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:15.684 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-18T12:57:15.684 INFO:tasks.ceph:role: osd.2 2024-09-18T12:57:15.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-18T12:57:15.685 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:57:16.272 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-18T12:57:16.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-18T12:57:16.274 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:16.403 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:16.438 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T12:57:16.505 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-18T12:57:16.505 INFO:tasks.ceph:role: osd.3 2024-09-18T12:57:16.506 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-18T12:57:16.506 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T12:57:16.580 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:57:16.580 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:57:16.580 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:57:16.580 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T12:57:16.581 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:57:16.581 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:57:16.581 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:57:16.581 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T12:57:16.581 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:57:16.581 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:57:17.025 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-18T12:57:17.027 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-18T12:57:17.027 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-18T12:57:17.117 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T12:57:17.146 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:17.466 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:17.467 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:17,467 seastar - Reactor backend: linux-aio 2024-09-18T12:57:17.481 INFO:teuthology.orchestra.run.smithi176.stderr:==27396==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:17.626 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc9da0f 0xbb76399 0xbb77904 0xbb77b1a 0xbb77c70 0xbb78139 0x3e6ef 0x3750a 0x5fcb31c 0x5fcbdd5 0x5fcc23a 0x6027464 0x5fa7646 0x5fa7820 0x5fa7dac 0x5def937 0x5e07b79 0x71461d2 0x71579a5 0x7158e42 0x7158ec7 0x7158fc9 0x71590c1 0x71592ce 0x71594b4 0x7159803 0x7159ba7 0x7159dd7 0x715a041 0x715a30e 0x715a52c 0x715a5e4 0x715a6aa 0x715a78b 0x5c52778 0x5c52882 0x5c5293e 0x5c529fa 0x5c52ab6 0x5c52c03 0x5c52d8e 0x5c5314f 0x5c6cf52 0xbb8a947 0xbba27c5 0xbc5006f 0xbc516bd 0xb91ff8d 0xb9207c5 0x3968cb2 0x396a48c 0x380ade2 0x2958f 0x2963f 0x35f29b4 2024-09-18T12:57:17.626 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-18T12:57:17.683 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc9da0f 0xbb76399 0xbb77904 0xbb77b1a 0xbb77c70 0xbb78139 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0x3973304 0x458545e 0x4616859 0x5fca931 0x5fcab62 0x5fa7bfb 0x5def937 0x5e07b79 0x71461d2 0x71579a5 0x7158e42 0x7158ec7 0x7158fc9 0x71590c1 0x71592ce 0x71594b4 0x7159803 0x7159ba7 0x7159dd7 0x715a041 0x715a30e 0x715a52c 0x715a5e4 0x715a6aa 0x715a78b 0x5c52778 0x5c52882 0x5c5293e 0x5c529fa 0x5c52ab6 0x5c52c03 0x5c52d8e 0x5c5314f 0x5c6cf52 0xbb8a947 0xbba27c5 0xbc5006f 0xbc516bd 0xb91ff8d 0xb9207c5 0x3968cb2 0x396a48c 0x380ade2 0x2958f 0x2963f 0x35f29b4 2024-09-18T12:57:17.683 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-18T12:57:17.721 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:17,721 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-18T12:57:17.721 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:17,721 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-18T12:57:17.723 INFO:teuthology.orchestra.run.smithi176.stderr:DEBUG 2024-09-18 12:57:17,723 [shard 0:main] seastar - reactor::drain 2024-09-18T12:57:18.293 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:18.294 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-18T12:57:18.294 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-18T12:57:18.294 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:18.294 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:18.294 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-18T12:57:18.350 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:18.353 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:18,353 seastar - Reactor backend: linux-aio 2024-09-18T12:57:18.363 INFO:teuthology.orchestra.run.smithi176.stderr:==27392==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:18.428 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc9da0f 0xbb76399 0xbb77904 0xbb77b1a 0xbb77c70 0xbb78139 0x3e6ef 0x133c1f 0xdd332 0x4b14c 0x38215be 0x5fcc0ae 0x5fcc245 0x6027464 0x5fa7646 0x5fa7b7a 0x5def937 0x5e07b79 0x71461d2 0x71579a5 0x7158e42 0x7158ec7 0x7158fc9 0x71590c1 0x71592ce 0x71594b4 0x7159803 0x7159ba7 0x7159dd7 0x715a041 0x715a30e 0x715a52c 0x715a5e4 0x715a6aa 0x715a78b 0x5c52778 0x5c52882 0x5c5293e 0x5c529fa 0x5c52ab6 0x5c52c03 0x5c52d8e 0x5c5314f 0x5c6cf52 0xbb8a947 0xbba27c5 0xbc5006f 0xbc516bd 0xb91ff8d 0xb9207c5 0x380b5f2 0x2958f 0x2963f 0x35f29b4 2024-09-18T12:57:18.428 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-18T12:57:23.044 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:23.044 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-18T12:57:23.045 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-18T12:57:23.045 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:23.045 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:23.045 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-18T12:57:23.066 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:57:23.091 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:23.371 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:23.372 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:23,372 seastar - Reactor backend: linux-aio 2024-09-18T12:57:23.377 INFO:teuthology.orchestra.run.smithi176.stderr:==27583==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:23.484 INFO:teuthology.orchestra.run.smithi176.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc9da0f 0xbb76399 0xbb77904 0xbb77b1a 0xbb77c70 0xbb78139 0x3e6ef 0x133c54 0xdd332 0x4ab1c 0x5fd8526 0x5fd86ee 0x5fd891f 0x5fd8bf5 0x60272f3 0x60274f9 0x5fa7646 0x5fa7820 0x5fa7dac 0x5def937 0x5e07b79 0x71461d2 0x71579a5 0x7158e42 0x7158ec7 0x7158fc9 0x71590c1 0x71592ce 0x71594b4 0x7159803 0x7159ba7 0x7159dd7 0x715a041 0x715a30e 0x715a52c 0x715a5e4 0x715a6aa 0x715a78b 0x5c52778 0x5c52882 0x5c5293e 0x5c529fa 0x5c52ab6 0x5c52c03 0x5c52d8e 0x5c5314f 0x5c6cf52 0xbb8a947 0xbba27c5 0xbc5006f 0xbc516bd 0xb91ff8d 0xb9207c5 0x3968cb2 0x396a48c 0x380ade2 0x2958f 0x2963f 0x35f29b4 2024-09-18T12:57:23.484 INFO:teuthology.orchestra.run.smithi176.stderr:kernel callstack: 2024-09-18T12:57:23.498 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:23,497 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-18T12:57:23.498 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:23,498 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-18T12:57:23.498 INFO:teuthology.orchestra.run.smithi176.stderr:DEBUG 2024-09-18 12:57:23,498 [shard 0:main] seastar - reactor::drain 2024-09-18T12:57:23.997 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:23.997 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-18T12:57:23.997 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-18T12:57:23.997 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:23.997 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:23.997 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-18T12:57:24.054 INFO:teuthology.orchestra.run.smithi176.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-18T12:57:24.057 INFO:teuthology.orchestra.run.smithi176.stderr:INFO 2024-09-18 12:57:24,057 seastar - Reactor backend: linux-aio 2024-09-18T12:57:24.076 INFO:teuthology.orchestra.run.smithi176.stderr:==27581==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-18T12:57:29.033 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:29.033 INFO:teuthology.orchestra.run.smithi176.stderr:Suppressions used: 2024-09-18T12:57:29.033 INFO:teuthology.orchestra.run.smithi176.stderr: count bytes template 2024-09-18T12:57:29.033 INFO:teuthology.orchestra.run.smithi176.stderr: 1 8 MallocExtension::Register 2024-09-18T12:57:29.033 INFO:teuthology.orchestra.run.smithi176.stderr:----------------------------------------------------- 2024-09-18T12:57:29.033 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-18T12:57:29.057 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:57:29.081 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T12:57:29.082 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:29.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T12:57:29.112 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:29.112 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T12:57:29.180 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:29.180 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T12:57:29.205 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:29.205 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T12:57:29.269 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:29.269 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T12:57:29.333 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:29.333 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T12:57:29.351 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:29.351 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-18T12:57:29.389 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T12:57:29.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAhzupmJrTHBBAAr0qN5spZOPQVmbMrfYJA+A== 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAmzupmps8TMRAAkkt34qUy8yYaCnNzvSJp2Q== 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAezupmJnydExAABWJWg+yYVnLzLXVJPD/vcw== 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-09-18T12:57:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAuzupmOiyFHhAA5ZIv+joOLne/fy/BF/aGKA== 2024-09-18T12:57:29.417 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-09-18T12:57:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA0zupmRNpWDRAAjGaOWo6fSaJW8OX4z1aG/A== 2024-09-18T12:57:29.417 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-18T12:57:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAezupm1BDVFhAAyKy0drLMV8faOXYsZMttiQ== 2024-09-18T12:57:29.417 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-09-18T12:57:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAezupmSUygGhAAGF5GtYgRLVk7kvbrEa3NaQ== 2024-09-18T12:57:29.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:57:29.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:57:29.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T12:57:29.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:57:29.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:57:29.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T12:57:29.829 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T12:57:29.893 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T12:57:29.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T12:57:29.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T12:57:30.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.024+0000 7f8a9a45cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.024+0000 7f8a9a45cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.039 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T12:57:30.064 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:57:30.119 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T12:57:30.119 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T12:57:30.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T12:57:30.161 INFO:tasks.ceph.mon.a:Started 2024-09-18T12:57:30.161 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T12:57:30.162 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T12:57:30.162 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T12:57:30.165 INFO:tasks.ceph.mgr.x:Started 2024-09-18T12:57:30.165 DEBUG:tasks.ceph:set 0 configs 2024-09-18T12:57:30.165 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T12:57:30.165 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T12:57:30.242 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-18T12:57:30.241+0000 7f8c98e4cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.243 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-18T12:57:30.241+0000 7f8c98e4cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.243 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-18T12:57:30.242+0000 7f8c98e4cc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.258 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-18T12:57:30.257+0000 7fac1c821000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.266+0000 7ff67e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.273+0000 7ff67e991640 1 Processor -- start 2024-09-18T12:57:30.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.273+0000 7ff67e991640 1 -- start start 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.274+0000 7ff67e991640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff67809d1b0 0x7ff678138520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.274+0000 7ff67e991640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67806d600 con 0x7ff67809c690 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.274+0000 7ff67e991640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff678075380 con 0x7ff67809d1b0 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.274+0000 7ff677fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff67809c690 0x7ff67809caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:32982/0 (socket says 172.21.15.120:32982) 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.274+0000 7ff677fff640 1 -- 172.21.15.120:0/3871163794 learned_addr learned my addr 172.21.15.120:0/3871163794 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.274+0000 7ff6777fe640 1 --2- 172.21.15.120:0/3871163794 >> v2:172.21.15.120:3300/0 conn(0x7ff67809d1b0 0x7ff678138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920624092 0 0) 0x7ff67806d600 con 0x7ff67809c690 2024-09-18T12:57:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff660003580 con 0x7ff67809c690 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3562430277 0 0) 0x7ff660003580 con 0x7ff67809c690 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 >> v2:172.21.15.120:3300/0 conn(0x7ff67809d1b0 msgr2=0x7ff678138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 --2- 172.21.15.120:0/3871163794 >> v2:172.21.15.120:3300/0 conn(0x7ff67809d1b0 0x7ff678138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67809da50 con 0x7ff67809c690 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2245176344 0 0) 0x7ff668001620 con 0x7ff67809c690 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 >> v1:172.21.15.120:6789/0 conn(0x7ff67809c690 legacy=0x7ff67809caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 --2- 172.21.15.120:0/3871163794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff660003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600045f0 con 0x7ff660003ae0 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff677fff640 1 --2- 172.21.15.120:0/3871163794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff660003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.275+0000 7ff677fff640 1 -- 172.21.15.120:0/3871163794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff660003580 con 0x7ff660003ae0 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.276+0000 7ff677fff640 1 --2- 172.21.15.120:0/3871163794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff660003f30 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423afa72d3364721 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.276+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff668007cc0 con 0x7ff660003ae0 2024-09-18T12:57:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.276+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff668005930 con 0x7ff660003ae0 2024-09-18T12:57:30.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.276+0000 7ff676ffd640 1 -- 172.21.15.120:0/3871163794 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff668005bd0 con 0x7ff660003ae0 2024-09-18T12:57:30.279 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-18T12:57:30.276+0000 7fac1c821000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.280 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-18T12:57:30.277+0000 7fac1c821000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.276+0000 7ff67e991640 1 -- 172.21.15.120:0/3871163794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 msgr2=0x7ff660003f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.276+0000 7ff67e991640 1 --2- 172.21.15.120:0/3871163794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff660003f30 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.277+0000 7ff67e991640 1 -- 172.21.15.120:0/3871163794 shutdown_connections 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.277+0000 7ff67e991640 1 --2- 172.21.15.120:0/3871163794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff660003f30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.277+0000 7ff67e991640 1 --2- 172.21.15.120:0/3871163794 >> v2:172.21.15.120:3300/0 conn(0x7ff67809d1b0 0x7ff678138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.277+0000 7ff67e991640 1 -- 172.21.15.120:0/3871163794 >> 172.21.15.120:0/3871163794 conn(0x7ff6780a3230 msgr2=0x7ff6780a3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.277+0000 7ff67e991640 1 -- 172.21.15.120:0/3871163794 shutdown_connections 2024-09-18T12:57:30.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.277+0000 7ff67e991640 1 -- 172.21.15.120:0/3871163794 wait complete. 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.277+0000 7ff67e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.278+0000 7ff67e991640 1 Processor -- start 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.278+0000 7ff67e991640 1 -- start start 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.279+0000 7ff67e991640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff678130b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.279+0000 7ff67e991640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff67808dfe0 con 0x7ff660003ae0 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.279+0000 7ff677fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff678130b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.279+0000 7ff677fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff678130b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51576/0 (socket says 172.21.15.120:51576) 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.279+0000 7ff677fff640 1 -- 172.21.15.120:0/551136056 learned_addr learned my addr 172.21.15.120:0/551136056 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff677fff640 1 -- 172.21.15.120:0/551136056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff678074090 con 0x7ff660003ae0 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff677fff640 1 --2- 172.21.15.120:0/551136056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff678130b90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff674ff9640 1 -- 172.21.15.120:0/551136056 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff668001ba0 con 0x7ff660003ae0 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff674ff9640 1 -- 172.21.15.120:0/551136056 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff668001080 con 0x7ff660003ae0 2024-09-18T12:57:30.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff674ff9640 1 -- 172.21.15.120:0/551136056 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff668007170 con 0x7ff660003ae0 2024-09-18T12:57:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff678132450 con 0x7ff660003ae0 2024-09-18T12:57:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67809bd80 con 0x7ff660003ae0 2024-09-18T12:57:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff674ff9640 1 -- 172.21.15.120:0/551136056 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff668016420 con 0x7ff660003ae0 2024-09-18T12:57:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.280+0000 7ff674ff9640 1 -- 172.21.15.120:0/551136056 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7ff668015970 con 0x7ff660003ae0 2024-09-18T12:57:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.281+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67809e980 con 0x7ff660003ae0 2024-09-18T12:57:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.283+0000 7ff674ff9640 1 -- 172.21.15.120:0/551136056 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7ff6680076b0 con 0x7ff660003ae0 2024-09-18T12:57:30.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.345+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff67809f310 con 0x7ff660003ae0 2024-09-18T12:57:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.346+0000 7ff674ff9640 1 -- 172.21.15.120:0/551136056 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7ff668015bd0 con 0x7ff660003ae0 2024-09-18T12:57:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-09-18T12:57:30.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.347+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 msgr2=0x7ff678130b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:30.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.347+0000 7ff67e991640 1 --2- 172.21.15.120:0/551136056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff678130b90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.347+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 shutdown_connections 2024-09-18T12:57:30.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.347+0000 7ff67e991640 1 --2- 172.21.15.120:0/551136056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff660003ae0 0x7ff678130b90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.347+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 >> 172.21.15.120:0/551136056 conn(0x7ff6780a3230 msgr2=0x7ff67812a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:30.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.347+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 shutdown_connections 2024-09-18T12:57:30.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.347+0000 7ff67e991640 1 -- 172.21.15.120:0/551136056 wait complete. 2024-09-18T12:57:30.359 INFO:tasks.ceph:check_enable_crimson: True 2024-09-18T12:57:30.359 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-18T12:57:30.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-18T12:57:30.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.458+0000 7f07b7c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.464+0000 7f07b7c23640 1 Processor -- start 2024-09-18T12:57:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.464+0000 7f07b7c23640 1 -- start start 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b7c23640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f07b009e910 0x7f07b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b7c23640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b006d370 con 0x7f07b009f040 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b7c23640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f07b0070cb0 con 0x7f07b009e910 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b51be640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f07b009e910 0x7f07b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b59bf640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f07b009f040 0x7f07b0068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:32994/0 (socket says 172.21.15.120:32994) 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b59bf640 1 -- 172.21.15.120:0/3449910314 learned_addr learned my addr 172.21.15.120:0/3449910314 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b51be640 1 -- 172.21.15.120:0/3449910314 >> v1:172.21.15.120:6789/0 conn(0x7f07b009f040 legacy=0x7f07b0068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b49bd640 1 -- 172.21.15.120:0/3449910314 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064759673 0 0) 0x7f07b006d370 con 0x7f07b009f040 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b51be640 1 -- 172.21.15.120:0/3449910314 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b009c1c0 con 0x7f07b009e910 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.465+0000 7f07b51be640 1 --2- 172.21.15.120:0/3449910314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0069450 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79553d4230fe816d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b49bd640 1 -- 172.21.15.120:0/3449910314 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a0009d90 con 0x7f07b009e910 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b49bd640 1 -- 172.21.15.120:0/3449910314 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f07a000e230 con 0x7f07b009e910 2024-09-18T12:57:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b49bd640 1 -- 172.21.15.120:0/3449910314 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a000e4d0 con 0x7f07b009e910 2024-09-18T12:57:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b7c23640 1 -- 172.21.15.120:0/3449910314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 msgr2=0x7f07b0069450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b7c23640 1 --2- 172.21.15.120:0/3449910314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0069450 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b7c23640 1 -- 172.21.15.120:0/3449910314 shutdown_connections 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b7c23640 1 --2- 172.21.15.120:0/3449910314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0069450 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b7c23640 1 -- 172.21.15.120:0/3449910314 >> 172.21.15.120:0/3449910314 conn(0x7f07b00a32a0 msgr2=0x7f07b00a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.466+0000 7f07b7c23640 1 -- 172.21.15.120:0/3449910314 shutdown_connections 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.467+0000 7f07b7c23640 1 -- 172.21.15.120:0/3449910314 wait complete. 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.467+0000 7f07b7c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.468+0000 7f07b7c23640 1 Processor -- start 2024-09-18T12:57:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.468+0000 7f07b7c23640 1 -- start start 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.469+0000 7f07b7c23640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0098f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.469+0000 7f07b7c23640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f07b009ba00 con 0x7f07b009e910 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.469+0000 7f07b59bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0098f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.469+0000 7f07b59bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0098f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51602/0 (socket says 172.21.15.120:51602) 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.469+0000 7f07b59bf640 1 -- 172.21.15.120:0/3674833198 learned_addr learned my addr 172.21.15.120:0/3674833198 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.469+0000 7f07b59bf640 1 -- 172.21.15.120:0/3674833198 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b0097800 con 0x7f07b009e910 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07b59bf640 1 --2- 172.21.15.120:0/3674833198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0098f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07a67fc640 1 -- 172.21.15.120:0/3674833198 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07ac005a60 con 0x7f07b009e910 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07a67fc640 1 -- 172.21.15.120:0/3674833198 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f07ac005bc0 con 0x7f07b009e910 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07a67fc640 1 -- 172.21.15.120:0/3674833198 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07ac005e60 con 0x7f07b009e910 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b009bf20 con 0x7f07b009e910 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b00986c0 con 0x7f07b009e910 2024-09-18T12:57:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07a67fc640 1 -- 172.21.15.120:0/3674833198 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f07ac007440 con 0x7f07b009e910 2024-09-18T12:57:30.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.470+0000 7f07a67fc640 1 -- 172.21.15.120:0/3674833198 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7f07ac00f980 con 0x7f07b009e910 2024-09-18T12:57:30.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.471+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b00988b0 con 0x7f07b009e910 2024-09-18T12:57:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.473+0000 7f07a67fc640 1 -- 172.21.15.120:0/3674833198 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f07ac00fbe0 con 0x7f07b009e910 2024-09-18T12:57:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:30.545+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7f07b0068d40 con 0x7f07b009e910 2024-09-18T12:57:30.547 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-18T12:57:30.545+0000 7f8c90df4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-18T12:57:30.547 INFO:tasks.ceph.mon.a.smithi120.stderr:Please be aware that this feature is experimental, untested, 2024-09-18T12:57:30.547 INFO:tasks.ceph.mon.a.smithi120.stderr:unsupported, and may result in data corruption, data loss, 2024-09-18T12:57:30.547 INFO:tasks.ceph.mon.a.smithi120.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-18T12:57:30.547 INFO:tasks.ceph.mon.a.smithi120.stderr:feature with important data. 2024-09-18T12:57:30.547 INFO:tasks.ceph.mon.a.smithi120.stderr: 2024-09-18T12:57:31.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.347+0000 7f07a67fc640 1 -- 172.21.15.120:0/3674833198 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7f07ac00fd80 con 0x7f07b009e910 2024-09-18T12:57:31.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.348+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 msgr2=0x7f07b0098f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:31.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.348+0000 7f07b7c23640 1 --2- 172.21.15.120:0/3674833198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0098f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.348+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 shutdown_connections 2024-09-18T12:57:31.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.348+0000 7f07b7c23640 1 --2- 172.21.15.120:0/3674833198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07b009e910 0x7f07b0098f40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.348+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 >> 172.21.15.120:0/3674833198 conn(0x7f07b00a32a0 msgr2=0x7f07b0072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:31.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.348+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 shutdown_connections 2024-09-18T12:57:31.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:31.348+0000 7f07b7c23640 1 -- 172.21.15.120:0/3674833198 wait complete. 2024-09-18T12:57:31.361 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T12:57:31.361 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:31.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T12:57:31.387 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:57:31.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T12:57:31.452 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:31.452 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T12:57:31.477 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-18T12:57:31.477 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T12:57:31.542 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c 0 2024-09-18T12:57:31.690 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.683+0000 7fa5aad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:31.691 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.690+0000 7fa5aad11640 1 Processor -- start 2024-09-18T12:57:31.691 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.690+0000 7fa5aad11640 1 -- start start 2024-09-18T12:57:31.691 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.690+0000 7fa5aad11640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa5a4112000 0x7fa5a4112410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:31.691 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.690+0000 7fa5aad11640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a4112ba0 con 0x7fa5a4116ef0 2024-09-18T12:57:31.691 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.690+0000 7fa5aad11640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a4117a10 con 0x7fa5a4112000 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a8aad640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa5a4112000 0x7fa5a4112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a3fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa5a4116ef0 0x7fa5a4117300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.176:44186/0 (socket says 172.21.15.176:44186) 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a8aad640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa5a4112000 0x7fa5a4112410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.176:58154/0 (socket says 172.21.15.176:58154) 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a3fff640 1 -- 172.21.15.176:0/3889807096 learned_addr learned my addr 172.21.15.176:0/3889807096 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a8aad640 1 -- 172.21.15.176:0/3889807096 >> v1:172.21.15.120:6789/0 conn(0x7fa5a4116ef0 legacy=0x7fa5a4117300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a37fe640 1 -- 172.21.15.176:0/3889807096 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625268051 0 0) 0x7fa5a4112ba0 con 0x7fa5a4116ef0 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a8aad640 1 -- 172.21.15.176:0/3889807096 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a4117b80 con 0x7fa5a4112000 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a8aad640 1 --2- 172.21.15.176:0/3889807096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a4112410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d121f562d48bf2a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a37fe640 1 -- 172.21.15.176:0/3889807096 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c009d90 con 0x7fa5a4112000 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a37fe640 1 -- 172.21.15.176:0/3889807096 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa59c00e230 con 0x7fa5a4112000 2024-09-18T12:57:31.694 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.691+0000 7fa5a37fe640 1 -- 172.21.15.176:0/3889807096 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c00e4d0 con 0x7fa5a4112000 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.692+0000 7fa5aad11640 1 -- 172.21.15.176:0/3889807096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 msgr2=0x7fa5a4112410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.692+0000 7fa5aad11640 1 --2- 172.21.15.176:0/3889807096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a4112410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.692+0000 7fa5aad11640 1 -- 172.21.15.176:0/3889807096 shutdown_connections 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.692+0000 7fa5aad11640 1 --2- 172.21.15.176:0/3889807096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a4112410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.692+0000 7fa5aad11640 1 -- 172.21.15.176:0/3889807096 >> 172.21.15.176:0/3889807096 conn(0x7fa5a40703e0 msgr2=0x7fa5a4072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.692+0000 7fa5aad11640 1 -- 172.21.15.176:0/3889807096 shutdown_connections 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.692+0000 7fa5aad11640 1 -- 172.21.15.176:0/3889807096 wait complete. 2024-09-18T12:57:31.695 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.693+0000 7fa5aad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:31.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.693+0000 7fa5aad11640 1 Processor -- start 2024-09-18T12:57:31.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.693+0000 7fa5aad11640 1 -- start start 2024-09-18T12:57:31.697 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.694+0000 7fa5aad11640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a41a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.694+0000 7fa5aad11640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41a7d00 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.694+0000 7fa5a8aad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a41a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.694+0000 7fa5a8aad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a41a7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.176:58160/0 (socket says 172.21.15.176:58160) 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.694+0000 7fa5a8aad640 1 -- 172.21.15.176:0/1901844931 learned_addr learned my addr 172.21.15.176:0/1901844931 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.694+0000 7fa5a8aad640 1 -- 172.21.15.176:0/1901844931 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a41a7e40 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5a8aad640 1 --2- 172.21.15.176:0/1901844931 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a41a7730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5a17fa640 1 -- 172.21.15.176:0/1901844931 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c013740 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5a17fa640 1 -- 172.21.15.176:0/1901844931 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa59c0138a0 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5a17fa640 1 -- 172.21.15.176:0/1901844931 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c013b40 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a41a8090 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a41ad010 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5a17fa640 1 -- 172.21.15.176:0/1901844931 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fa59c012780 con 0x7fa5a4112000 2024-09-18T12:57:31.698 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.695+0000 7fa5a17fa640 1 -- 172.21.15.176:0/1901844931 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7fa59c018040 con 0x7fa5a4112000 2024-09-18T12:57:31.699 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.696+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a4112410 con 0x7fa5a4112000 2024-09-18T12:57:31.699 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.698+0000 7fa5a17fa640 1 -- 172.21.15.176:0/1901844931 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fa59c013cf0 con 0x7fa5a4112000 2024-09-18T12:57:31.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.770+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c", "id": 0} v 0) -- 0x7fa5a4116ef0 con 0x7fa5a4112000 2024-09-18T12:57:31.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.771+0000 7fa5a17fa640 1 -- 172.21.15.176:0/1901844931 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7fa59c012c10 con 0x7fa5a4112000 2024-09-18T12:57:31.773 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-09-18T12:57:31.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.772+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 msgr2=0x7fa5a41a7730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:31.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.772+0000 7fa5aad11640 1 --2- 172.21.15.176:0/1901844931 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a41a7730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.772+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 shutdown_connections 2024-09-18T12:57:31.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.772+0000 7fa5aad11640 1 --2- 172.21.15.176:0/1901844931 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5a4112000 0x7fa5a41a7730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.772+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 >> 172.21.15.176:0/1901844931 conn(0x7fa5a40703e0 msgr2=0x7fa5a4071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:31.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.772+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 shutdown_connections 2024-09-18T12:57:31.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.772+0000 7fa5aad11640 1 -- 172.21.15.176:0/1901844931 wait complete. 2024-09-18T12:57:31.784 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 7c214373-8f9a-4112-a594-9ae4ec75bc1f 1 2024-09-18T12:57:31.892 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.885+0000 7fb1a82ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:31.893 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.892+0000 7fb1a82ac640 1 Processor -- start 2024-09-18T12:57:31.893 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.892+0000 7fb1a82ac640 1 -- start start 2024-09-18T12:57:31.894 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.892+0000 7fb1a82ac640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb1a011d970 0x7fb1a011fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.892+0000 7fb1a82ac640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1a01204a0 con 0x7fb1a011acb0 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.892+0000 7fb1a82ac640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb1a0121660 con 0x7fb1a011d970 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5847640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb1a011d970 0x7fb1a011fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5847640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb1a011d970 0x7fb1a011fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.176:58174/0 (socket says 172.21.15.176:58174) 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5847640 1 -- 172.21.15.176:0/1203291604 learned_addr learned my addr 172.21.15.176:0/1203291604 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a6048640 1 --1- 172.21.15.176:0/1203291604 >> v1:172.21.15.120:6789/0 conn(0x7fb1a011acb0 0x7fb1a011b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.176:44200/0 (socket says 172.21.15.176:44200) 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5847640 1 -- 172.21.15.176:0/1203291604 >> v1:172.21.15.120:6789/0 conn(0x7fb1a011acb0 legacy=0x7fb1a011b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5046640 1 -- 172.21.15.176:0/1203291604 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251523151 0 0) 0x7fb1a01204a0 con 0x7fb1a011acb0 2024-09-18T12:57:31.895 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5847640 1 -- 172.21.15.176:0/1203291604 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a01217d0 con 0x7fb1a011d970 2024-09-18T12:57:31.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5847640 1 --2- 172.21.15.176:0/1203291604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011d970 0x7fb1a011fdf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6b4b9f9cb72e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:31.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5046640 1 -- 172.21.15.176:0/1203291604 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb190009e50 con 0x7fb1a011d970 2024-09-18T12:57:31.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5046640 1 -- 172.21.15.176:0/1203291604 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb19000e230 con 0x7fb1a011d970 2024-09-18T12:57:31.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.893+0000 7fb1a5046640 1 -- 172.21.15.176:0/1203291604 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb19000e4d0 con 0x7fb1a011d970 2024-09-18T12:57:31.898 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.894+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1203291604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011d970 msgr2=0x7fb1a011fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.894+0000 7fb1a82ac640 1 --2- 172.21.15.176:0/1203291604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011d970 0x7fb1a011fdf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.894+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1203291604 shutdown_connections 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.894+0000 7fb1a82ac640 1 --2- 172.21.15.176:0/1203291604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011d970 0x7fb1a011fdf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.894+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1203291604 >> 172.21.15.176:0/1203291604 conn(0x7fb1a006e9b0 msgr2=0x7fb1a006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.894+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1203291604 shutdown_connections 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.894+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1203291604 wait complete. 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.895+0000 7fb1a82ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.895+0000 7fb1a82ac640 1 Processor -- start 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.895+0000 7fb1a82ac640 1 -- start start 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb1a82ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011acb0 0x7fb1a01a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb1a82ac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01a9f50 con 0x7fb1a011acb0 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb1a6048640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011acb0 0x7fb1a01a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:31.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb1a6048640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011acb0 0x7fb1a01a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.176:58188/0 (socket says 172.21.15.176:58188) 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb1a6048640 1 -- 172.21.15.176:0/1077445 learned_addr learned my addr 172.21.15.176:0/1077445 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb1a6048640 1 -- 172.21.15.176:0/1077445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a01aa090 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb1a6048640 1 --2- 172.21.15.176:0/1077445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011acb0 0x7fb1a01a9980 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.896+0000 7fb196ffd640 1 -- 172.21.15.176:0/1077445 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb19c004c60 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.897+0000 7fb196ffd640 1 -- 172.21.15.176:0/1077445 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb19c004dc0 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.897+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a01aa340 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.897+0000 7fb196ffd640 1 -- 172.21.15.176:0/1077445 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb19c007250 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.897+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a01af1e0 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.897+0000 7fb196ffd640 1 -- 172.21.15.176:0/1077445 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fb19c00c660 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.897+0000 7fb196ffd640 1 -- 172.21.15.176:0/1077445 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7fb19c00fbe0 con 0x7fb1a011acb0 2024-09-18T12:57:31.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.897+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a0121110 con 0x7fb1a011acb0 2024-09-18T12:57:31.901 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.900+0000 7fb196ffd640 1 -- 172.21.15.176:0/1077445 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fb19c00fe40 con 0x7fb1a011acb0 2024-09-18T12:57:31.971 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.970+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c214373-8f9a-4112-a594-9ae4ec75bc1f", "id": 1} v 0) -- 0x7fb1a0120990 con 0x7fb1a011acb0 2024-09-18T12:57:31.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.971+0000 7fb196ffd640 1 -- 172.21.15.176:0/1077445 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c214373-8f9a-4112-a594-9ae4ec75bc1f", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7fb19c00f230 con 0x7fb1a011acb0 2024-09-18T12:57:31.973 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-18T12:57:31.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.972+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011acb0 msgr2=0x7fb1a01a9980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:31.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.972+0000 7fb1a82ac640 1 --2- 172.21.15.176:0/1077445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011acb0 0x7fb1a01a9980 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.972+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 shutdown_connections 2024-09-18T12:57:31.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.972+0000 7fb1a82ac640 1 --2- 172.21.15.176:0/1077445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1a011acb0 0x7fb1a01a9980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:31.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.972+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 >> 172.21.15.176:0/1077445 conn(0x7fb1a006e9b0 msgr2=0x7fb1a011dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:31.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.972+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 shutdown_connections 2024-09-18T12:57:31.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:31.972+0000 7fb1a82ac640 1 -- 172.21.15.176:0/1077445 wait complete. 2024-09-18T12:57:31.984 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 40171e53-c072-4abe-9d3c-68ca18165c56 2 2024-09-18T12:57:32.092 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.085+0000 7fd4e5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:32.093 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.091+0000 7fd4e5751640 1 Processor -- start 2024-09-18T12:57:32.093 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.091+0000 7fd4e5751640 1 -- start start 2024-09-18T12:57:32.093 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4e5751640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4e01124b0 0x7fd4e011e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:32.093 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4e5751640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e0112950 con 0x7fd4e0075010 2024-09-18T12:57:32.093 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4e5751640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e0112ae0 con 0x7fd4e01124b0 2024-09-18T12:57:32.094 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4de7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4e01124b0 0x7fd4e011e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:32.094 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4deffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd4e0075010 0x7fd4e0111da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.176:44206/0 (socket says 172.21.15.176:44206) 2024-09-18T12:57:32.094 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4deffd640 1 -- 172.21.15.176:0/3233221607 learned_addr learned my addr 172.21.15.176:0/3233221607 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4ddffb640 1 -- 172.21.15.176:0/3233221607 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941197204 0 0) 0x7fd4e0112950 con 0x7fd4e0075010 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4ddffb640 1 -- 172.21.15.176:0/3233221607 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c8003580 con 0x7fd4e0075010 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4de7fc640 1 -- 172.21.15.176:0/3233221607 >> v1:172.21.15.120:6789/0 conn(0x7fd4e0075010 legacy=0x7fd4e0111da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.092+0000 7fd4de7fc640 1 -- 172.21.15.176:0/3233221607 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e0112c20 con 0x7fd4e01124b0 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.093+0000 7fd4de7fc640 1 --2- 172.21.15.176:0/3233221607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e01124b0 0x7fd4e011e130 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e51d71344baab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.093+0000 7fd4ddffb640 1 -- 172.21.15.176:0/3233221607 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4d0009d90 con 0x7fd4e01124b0 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.093+0000 7fd4ddffb640 1 -- 172.21.15.176:0/3233221607 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd4d000e230 con 0x7fd4e01124b0 2024-09-18T12:57:32.095 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.093+0000 7fd4ddffb640 1 -- 172.21.15.176:0/3233221607 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4d000e4d0 con 0x7fd4e01124b0 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 1 -- 172.21.15.176:0/3233221607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e01124b0 msgr2=0x7fd4e011e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 1 --2- 172.21.15.176:0/3233221607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e01124b0 0x7fd4e011e130 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 1 -- 172.21.15.176:0/3233221607 shutdown_connections 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 1 --2- 172.21.15.176:0/3233221607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e01124b0 0x7fd4e011e130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 1 -- 172.21.15.176:0/3233221607 >> 172.21.15.176:0/3233221607 conn(0x7fd4e00708e0 msgr2=0x7fd4e0072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 1 -- 172.21.15.176:0/3233221607 shutdown_connections 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 1 -- 172.21.15.176:0/3233221607 wait complete. 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.094+0000 7fd4e5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.095+0000 7fd4e5751640 1 Processor -- start 2024-09-18T12:57:32.098 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.095+0000 7fd4e5751640 1 -- start start 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.095+0000 7fd4e5751640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e0075010 0x7fd4e0112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.095+0000 7fd4e5751640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0114da0 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e0075010 0x7fd4e0112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e0075010 0x7fd4e0112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.176:58208/0 (socket says 172.21.15.176:58208) 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4deffd640 1 -- 172.21.15.176:0/1136287034 learned_addr learned my addr 172.21.15.176:0/1136287034 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4deffd640 1 -- 172.21.15.176:0/1136287034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e0114ee0 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4deffd640 1 --2- 172.21.15.176:0/1136287034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e0075010 0x7fd4e0112fd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4c77fe640 1 -- 172.21.15.176:0/1136287034 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4d4005a60 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4c77fe640 1 -- 172.21.15.176:0/1136287034 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd4d4005bc0 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4c77fe640 1 -- 172.21.15.176:0/1136287034 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4d4005e60 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e0113570 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e0113a10 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.096+0000 7fd4c77fe640 1 -- 172.21.15.176:0/1136287034 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fd4d400cb80 con 0x7fd4e0075010 2024-09-18T12:57:32.099 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.097+0000 7fd4c77fe640 1 -- 172.21.15.176:0/1136287034 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7fd4d400f230 con 0x7fd4e0075010 2024-09-18T12:57:32.100 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.097+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e011ae00 con 0x7fd4e0075010 2024-09-18T12:57:32.101 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.100+0000 7fd4c77fe640 1 -- 172.21.15.176:0/1136287034 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fd4d400ce30 con 0x7fd4e0075010 2024-09-18T12:57:32.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.171+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "40171e53-c072-4abe-9d3c-68ca18165c56", "id": 2} v 0) -- 0x7fd4e0113d10 con 0x7fd4e0075010 2024-09-18T12:57:32.174 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.173+0000 7fd4c77fe640 1 -- 172.21.15.176:0/1136287034 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40171e53-c072-4abe-9d3c-68ca18165c56", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7fd4d4007180 con 0x7fd4e0075010 2024-09-18T12:57:32.174 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-09-18T12:57:32.175 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.174+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e0075010 msgr2=0x7fd4e0112fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.175 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.174+0000 7fd4e5751640 1 --2- 172.21.15.176:0/1136287034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e0075010 0x7fd4e0112fd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.175 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.174+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 shutdown_connections 2024-09-18T12:57:32.175 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.174+0000 7fd4e5751640 1 --2- 172.21.15.176:0/1136287034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e0075010 0x7fd4e0112fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.175 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.174+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 >> 172.21.15.176:0/1136287034 conn(0x7fd4e00708e0 msgr2=0x7fd4e0117f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:32.176 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.174+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 shutdown_connections 2024-09-18T12:57:32.176 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.174+0000 7fd4e5751640 1 -- 172.21.15.176:0/1136287034 wait complete. 2024-09-18T12:57:32.186 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new d7aca28d-af63-4f64-8ca2-3b4c010c6e0b 3 2024-09-18T12:57:32.294 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.287+0000 7ff128191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:32.294 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.293+0000 7ff128191640 1 Processor -- start 2024-09-18T12:57:32.295 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.293+0000 7ff128191640 1 -- start start 2024-09-18T12:57:32.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff128191640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff12011d970 0x7ff12011fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:32.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff128191640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1201204a0 con 0x7ff12011acb0 2024-09-18T12:57:32.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff128191640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff120121660 con 0x7ff12011d970 2024-09-18T12:57:32.297 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff12572c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff12011d970 0x7ff12011fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff125f2d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff12011acb0 0x7ff12011b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.176:44212/0 (socket says 172.21.15.176:44212) 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff12572c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff12011d970 0x7ff12011fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.176:58222/0 (socket says 172.21.15.176:58222) 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff125f2d640 1 -- 172.21.15.176:0/3904297367 learned_addr learned my addr 172.21.15.176:0/3904297367 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff12572c640 1 -- 172.21.15.176:0/3904297367 >> v1:172.21.15.120:6789/0 conn(0x7ff12011acb0 legacy=0x7ff12011b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.294+0000 7ff12572c640 1 -- 172.21.15.176:0/3904297367 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1201217d0 con 0x7ff12011d970 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.295+0000 7ff12572c640 1 --2- 172.21.15.176:0/3904297367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011d970 0x7ff12011fdf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7374a29a0f26bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.295+0000 7ff124f2b640 1 -- 172.21.15.176:0/3904297367 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff110009d90 con 0x7ff12011d970 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.295+0000 7ff124f2b640 1 -- 172.21.15.176:0/3904297367 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff11000e230 con 0x7ff12011d970 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.295+0000 7ff124f2b640 1 -- 172.21.15.176:0/3904297367 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff11000e4d0 con 0x7ff12011d970 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 1 -- 172.21.15.176:0/3904297367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011d970 msgr2=0x7ff12011fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.298 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 1 --2- 172.21.15.176:0/3904297367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011d970 0x7ff12011fdf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 1 -- 172.21.15.176:0/3904297367 shutdown_connections 2024-09-18T12:57:32.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 1 --2- 172.21.15.176:0/3904297367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011d970 0x7ff12011fdf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 1 -- 172.21.15.176:0/3904297367 >> 172.21.15.176:0/3904297367 conn(0x7ff12006e9b0 msgr2=0x7ff12006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:32.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 1 -- 172.21.15.176:0/3904297367 shutdown_connections 2024-09-18T12:57:32.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 1 -- 172.21.15.176:0/3904297367 wait complete. 2024-09-18T12:57:32.299 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.296+0000 7ff128191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:32.301 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.297+0000 7ff128191640 1 Processor -- start 2024-09-18T12:57:32.301 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.297+0000 7ff128191640 1 -- start start 2024-09-18T12:57:32.301 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.297+0000 7ff128191640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011acb0 0x7ff1201a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:32.301 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.297+0000 7ff128191640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff1201aa170 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.297+0000 7ff125f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011acb0 0x7ff1201a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.297+0000 7ff125f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011acb0 0x7ff1201a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.176:58236/0 (socket says 172.21.15.176:58236) 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.297+0000 7ff125f2d640 1 -- 172.21.15.176:0/1868291502 learned_addr learned my addr 172.21.15.176:0/1868291502 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff125f2d640 1 -- 172.21.15.176:0/1868291502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1201aa2b0 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff125f2d640 1 --2- 172.21.15.176:0/1868291502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011acb0 0x7ff1201a9ba0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff1167fc640 1 -- 172.21.15.176:0/1868291502 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff11c005a60 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff1167fc640 1 -- 172.21.15.176:0/1868291502 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff11c005bc0 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1201aa560 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff1167fc640 1 -- 172.21.15.176:0/1868291502 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff11c005e60 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1201af400 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff1167fc640 1 -- 172.21.15.176:0/1868291502 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff11c00cba0 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.298+0000 7ff1167fc640 1 -- 172.21.15.176:0/1868291502 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7ff11c00f230 con 0x7ff12011acb0 2024-09-18T12:57:32.302 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.299+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1201210f0 con 0x7ff12011acb0 2024-09-18T12:57:32.303 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.301+0000 7ff1167fc640 1 -- 172.21.15.176:0/1868291502 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7ff11c00ce50 con 0x7ff12011acb0 2024-09-18T12:57:32.373 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.372+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7aca28d-af63-4f64-8ca2-3b4c010c6e0b", "id": 3} v 0) -- 0x7ff1201afed0 con 0x7ff12011acb0 2024-09-18T12:57:32.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.374+0000 7ff1167fc640 1 -- 172.21.15.176:0/1868291502 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7aca28d-af63-4f64-8ca2-3b4c010c6e0b", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7ff11c0070b0 con 0x7ff12011acb0 2024-09-18T12:57:32.375 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-09-18T12:57:32.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.375+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011acb0 msgr2=0x7ff1201a9ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.375+0000 7ff128191640 1 --2- 172.21.15.176:0/1868291502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011acb0 0x7ff1201a9ba0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.375+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 shutdown_connections 2024-09-18T12:57:32.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.375+0000 7ff128191640 1 --2- 172.21.15.176:0/1868291502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12011acb0 0x7ff1201a9ba0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.375+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 >> 172.21.15.176:0/1868291502 conn(0x7ff12006e9b0 msgr2=0x7ff120118870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:32.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.375+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 shutdown_connections 2024-09-18T12:57:32.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-18T12:57:32.375+0000 7ff128191640 1 -- 172.21.15.176:0/1868291502 wait complete. 2024-09-18T12:57:32.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-18T12:57:32.423 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T12:57:32.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-18T12:57:32.465 INFO:tasks.ceph.osd.0:Started 2024-09-18T12:57:32.466 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-18T12:57:32.498 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T12:57:32.498 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-18T12:57:32.541 INFO:tasks.ceph.osd.1:Started 2024-09-18T12:57:32.542 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-18T12:57:32.572 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T12:57:32.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-18T12:57:32.614 INFO:tasks.ceph.osd.2:Started 2024-09-18T12:57:32.615 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-18T12:57:32.644 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T12:57:32.644 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-18T12:57:32.687 INFO:tasks.ceph.osd.3:Started 2024-09-18T12:57:32.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:57:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.795+0000 7f439d2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.800+0000 7f439d2bd640 1 Processor -- start 2024-09-18T12:57:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.800+0000 7f439d2bd640 1 -- start start 2024-09-18T12:57:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f439d2bd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f439809d570 0x7f439813b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f439d2bd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980a0060 con 0x7f439809ca50 2024-09-18T12:57:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f439d2bd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f439809fd30 con 0x7f439809d570 2024-09-18T12:57:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f438e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f439809d570 0x7f439813b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f4396ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f439809ca50 0x7f439809ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:32996/0 (socket says 172.21.15.120:32996) 2024-09-18T12:57:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f438e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f439809d570 0x7f439813b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51616/0 (socket says 172.21.15.120:51616) 2024-09-18T12:57:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f4396ffd640 1 -- 172.21.15.120:0/2305520180 learned_addr learned my addr 172.21.15.120:0/2305520180 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:32.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f438e7fc640 1 -- 172.21.15.120:0/2305520180 >> v1:172.21.15.120:6789/0 conn(0x7f439809ca50 legacy=0x7f439809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.801+0000 7f438e7fc640 1 -- 172.21.15.120:0/2305520180 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439809e3c0 con 0x7f439809d570 2024-09-18T12:57:32.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.802+0000 7f438e7fc640 1 --2- 172.21.15.120:0/2305520180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809d570 0x7f439813b3b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b7ddf973bf2a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:32.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.802+0000 7f43967fc640 1 -- 172.21.15.120:0/2305520180 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4380009d80 con 0x7f439809d570 2024-09-18T12:57:32.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.802+0000 7f43967fc640 1 -- 172.21.15.120:0/2305520180 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f438000e230 con 0x7f439809d570 2024-09-18T12:57:32.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.802+0000 7f43967fc640 1 -- 172.21.15.120:0/2305520180 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f438000e4d0 con 0x7f439809d570 2024-09-18T12:57:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.802+0000 7f439d2bd640 1 -- 172.21.15.120:0/2305520180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809d570 msgr2=0x7f439813b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.802+0000 7f439d2bd640 1 --2- 172.21.15.120:0/2305520180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809d570 0x7f439813b3b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.803+0000 7f439d2bd640 1 -- 172.21.15.120:0/2305520180 shutdown_connections 2024-09-18T12:57:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.803+0000 7f439d2bd640 1 --2- 172.21.15.120:0/2305520180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809d570 0x7f439813b3b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.803+0000 7f439d2bd640 1 -- 172.21.15.120:0/2305520180 >> 172.21.15.120:0/2305520180 conn(0x7f43980a5230 msgr2=0x7f43980a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.803+0000 7f439d2bd640 1 -- 172.21.15.120:0/2305520180 shutdown_connections 2024-09-18T12:57:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.803+0000 7f439d2bd640 1 -- 172.21.15.120:0/2305520180 wait complete. 2024-09-18T12:57:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.803+0000 7f439d2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.804+0000 7f439d2bd640 1 Processor -- start 2024-09-18T12:57:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.804+0000 7f439d2bd640 1 -- start start 2024-09-18T12:57:32.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.805+0000 7f439d2bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809ca50 0x7f4398122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.805+0000 7f439d2bd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4398124260 con 0x7f439809ca50 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.805+0000 7f4396ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809ca50 0x7f4398122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.805+0000 7f4396ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809ca50 0x7f4398122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51626/0 (socket says 172.21.15.120:51626) 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.805+0000 7f4396ffd640 1 -- 172.21.15.120:0/2462763772 learned_addr learned my addr 172.21.15.120:0/2462763772 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f4396ffd640 1 -- 172.21.15.120:0/2462763772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398126cf0 con 0x7f439809ca50 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f4396ffd640 1 --2- 172.21.15.120:0/2462763772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809ca50 0x7f4398122dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f438ffff640 1 -- 172.21.15.120:0/2462763772 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4388005a60 con 0x7f439809ca50 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f438ffff640 1 -- 172.21.15.120:0/2462763772 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4388005bc0 con 0x7f439809ca50 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43981269c0 con 0x7f439809ca50 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f438ffff640 1 -- 172.21.15.120:0/2462763772 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4388005e60 con 0x7f439809ca50 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4398126620 con 0x7f439809ca50 2024-09-18T12:57:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f438ffff640 1 -- 172.21.15.120:0/2462763772 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f4388007440 con 0x7f439809ca50 2024-09-18T12:57:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.806+0000 7f438ffff640 1 -- 172.21.15.120:0/2462763772 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f438800fb10 con 0x7f439809ca50 2024-09-18T12:57:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.807+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4398125120 con 0x7f439809ca50 2024-09-18T12:57:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.809+0000 7f438ffff640 1 -- 172.21.15.120:0/2462763772 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f438800fd70 con 0x7f439809ca50 2024-09-18T12:57:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.869+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f439809ce60 con 0x7f439809ca50 2024-09-18T12:57:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.870+0000 7f438ffff640 1 -- 172.21.15.120:0/2462763772 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f438800f5f0 con 0x7f439809ca50 2024-09-18T12:57:32.872 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:32.872 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"fsid":"663d1a24-c7eb-48da-8c03-7f80c4504c0c","created":"2024-09-18T12:57:30.264061+0000","modified":"2024-09-18T12:57:32.374074+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T12:57:32.374074+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c214373-8f9a-4112-a594-9ae4ec75bc1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"40171e53-c072-4abe-9d3c-68ca18165c56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7aca28d-af63-4f64-8ca2-3b4c010c6e0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:57:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.871+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809ca50 msgr2=0x7f4398122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.871+0000 7f439d2bd640 1 --2- 172.21.15.120:0/2462763772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809ca50 0x7f4398122dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.871+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 shutdown_connections 2024-09-18T12:57:32.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.871+0000 7f439d2bd640 1 --2- 172.21.15.120:0/2462763772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f439809ca50 0x7f4398122dc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:32.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.871+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 >> 172.21.15.120:0/2462763772 conn(0x7f43980a5230 msgr2=0x7f43980a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:32.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.871+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 shutdown_connections 2024-09-18T12:57:32.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:32.871+0000 7f439d2bd640 1 -- 172.21.15.120:0/2462763772 wait complete. 2024-09-18T12:57:32.884 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T12:57:32.884 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T12:57:33.287 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T12:57:33.393 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.386+0000 7fa7e0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:33.393 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.392+0000 7fa7e0191640 1 Processor -- start 2024-09-18T12:57:33.394 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.392+0000 7fa7e0191640 1 -- start start 2024-09-18T12:57:33.396 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7e0191640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7d80a04b0 0x7fa7d813b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:33.396 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7e0191640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d80a8300 con 0x7fa7d809f990 2024-09-18T12:57:33.396 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7e0191640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d80a08c0 con 0x7fa7d80a04b0 2024-09-18T12:57:33.396 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7dd72c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7d80a04b0 0x7fa7d813b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:33.396 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7ddf2d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa7d809f990 0x7fa7d809fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33010/0 (socket says 172.21.15.120:33010) 2024-09-18T12:57:33.396 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7ddf2d640 1 -- 172.21.15.120:0/937599955 learned_addr learned my addr 172.21.15.120:0/937599955 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:33.396 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7dd72c640 1 -- 172.21.15.120:0/937599955 >> v1:172.21.15.120:6789/0 conn(0x7fa7d809f990 legacy=0x7fa7d809fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:33.397 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7dd72c640 1 -- 172.21.15.120:0/937599955 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d80a14b0 con 0x7fa7d80a04b0 2024-09-18T12:57:33.397 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.393+0000 7fa7dd72c640 1 --2- 172.21.15.120:0/937599955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d80a04b0 0x7fa7d813b610 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4563a61e0cd0ac72 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:33.397 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.394+0000 7fa7dcf2b640 1 -- 172.21.15.120:0/937599955 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa7cc009d90 con 0x7fa7d80a04b0 2024-09-18T12:57:33.397 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.394+0000 7fa7dcf2b640 1 -- 172.21.15.120:0/937599955 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa7cc00e230 con 0x7fa7d80a04b0 2024-09-18T12:57:33.397 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.394+0000 7fa7dcf2b640 1 -- 172.21.15.120:0/937599955 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa7cc00e4d0 con 0x7fa7d80a04b0 2024-09-18T12:57:33.398 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.394+0000 7fa7e0191640 1 -- 172.21.15.120:0/937599955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d80a04b0 msgr2=0x7fa7d813b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:33.398 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.394+0000 7fa7e0191640 1 --2- 172.21.15.120:0/937599955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d80a04b0 0x7fa7d813b610 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:33.398 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.395+0000 7fa7e0191640 1 -- 172.21.15.120:0/937599955 shutdown_connections 2024-09-18T12:57:33.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.395+0000 7fa7e0191640 1 --2- 172.21.15.120:0/937599955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d80a04b0 0x7fa7d813b610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:33.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.395+0000 7fa7e0191640 1 -- 172.21.15.120:0/937599955 >> 172.21.15.120:0/937599955 conn(0x7fa7d80a6390 msgr2=0x7fa7d80a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:33.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.395+0000 7fa7e0191640 1 -- 172.21.15.120:0/937599955 shutdown_connections 2024-09-18T12:57:33.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.395+0000 7fa7e0191640 1 -- 172.21.15.120:0/937599955 wait complete. 2024-09-18T12:57:33.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.395+0000 7fa7e0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:33.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.396+0000 7fa7e0191640 1 Processor -- start 2024-09-18T12:57:33.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.396+0000 7fa7e0191640 1 -- start start 2024-09-18T12:57:33.401 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.397+0000 7fa7e0191640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d809f990 0x7fa7d81bb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:33.401 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.397+0000 7fa7e0191640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81b9bd0 con 0x7fa7d809f990 2024-09-18T12:57:33.401 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.397+0000 7fa7ddf2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d809f990 0x7fa7d81bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:33.401 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.397+0000 7fa7ddf2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d809f990 0x7fa7d81bb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51636/0 (socket says 172.21.15.120:51636) 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.397+0000 7fa7ddf2d640 1 -- 172.21.15.120:0/3814285537 learned_addr learned my addr 172.21.15.120:0/3814285537 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7ddf2d640 1 -- 172.21.15.120:0/3814285537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d81bb470 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7ddf2d640 1 --2- 172.21.15.120:0/3814285537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d809f990 0x7fa7d81bb910 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7ca7fc640 1 -- 172.21.15.120:0/3814285537 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa7d4005a60 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7ca7fc640 1 -- 172.21.15.120:0/3814285537 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa7d4005bc0 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d8073640 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7ca7fc640 1 -- 172.21.15.120:0/3814285537 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa7d4005e60 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d81ba8f0 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7ca7fc640 1 -- 172.21.15.120:0/3814285537 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fa7d400cb80 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.398+0000 7fa7ca7fc640 1 -- 172.21.15.120:0/3814285537 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7fa7d400ce30 con 0x7fa7d809f990 2024-09-18T12:57:33.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.399+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d809fda0 con 0x7fa7d809f990 2024-09-18T12:57:33.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.403+0000 7fa7ca7fc640 1 -- 172.21.15.120:0/3814285537 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fa7d400f230 con 0x7fa7d809f990 2024-09-18T12:57:33.466 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.464+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7d81bc130 con 0x7fa7d809f990 2024-09-18T12:57:33.466 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.464+0000 7fa7ca7fc640 1 -- 172.21.15.120:0/3814285537 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7fa7d4007160 con 0x7fa7d809f990 2024-09-18T12:57:33.466 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-18T12:57:33.467 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":7,"fsid":"663d1a24-c7eb-48da-8c03-7f80c4504c0c","created":"2024-09-18T12:57:30.264061+0000","modified":"2024-09-18T12:57:32.374074+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T12:57:32.374074+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c214373-8f9a-4112-a594-9ae4ec75bc1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"40171e53-c072-4abe-9d3c-68ca18165c56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7aca28d-af63-4f64-8ca2-3b4c010c6e0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:57:33.468 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.465+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d809f990 msgr2=0x7fa7d81bb910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:33.468 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.465+0000 7fa7e0191640 1 --2- 172.21.15.120:0/3814285537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d809f990 0x7fa7d81bb910 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:33.468 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.465+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 shutdown_connections 2024-09-18T12:57:33.468 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.465+0000 7fa7e0191640 1 --2- 172.21.15.120:0/3814285537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7d809f990 0x7fa7d81bb910 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:33.468 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.465+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 >> 172.21.15.120:0/3814285537 conn(0x7fa7d80a6390 msgr2=0x7fa7d80a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:33.468 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.465+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 shutdown_connections 2024-09-18T12:57:33.468 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:33.465+0000 7fa7e0191640 1 -- 172.21.15.120:0/3814285537 wait complete. 2024-09-18T12:57:33.477 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-18T12:57:35.580 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-18T12:57:35.579+0000 7fabb9fbd640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-18T12:57:39.880 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T12:57:39.986 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.979+0000 7f34ae111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:39.987 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.985+0000 7f34ae111640 1 Processor -- start 2024-09-18T12:57:39.987 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.985+0000 7f34ae111640 1 -- start start 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34ae111640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f34a809f990 0x7f34a809fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34ae111640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34a80a8300 con 0x7f34a80a02e0 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34ae111640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f34a80a14b0 con 0x7f34a809f990 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34a77fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f34a809f990 0x7f34a809fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34a6ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f34a80a02e0 0x7f34a813a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33026/0 (socket says 172.21.15.120:33026) 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34a6ffd640 1 -- 172.21.15.120:0/1653065805 learned_addr learned my addr 172.21.15.120:0/1653065805 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34a77fe640 1 -- 172.21.15.120:0/1653065805 >> v1:172.21.15.120:6789/0 conn(0x7f34a80a02e0 legacy=0x7f34a813a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34a77fe640 1 -- 172.21.15.120:0/1653065805 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a80a1710 con 0x7f34a809f990 2024-09-18T12:57:39.989 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.986+0000 7f34a67fc640 1 -- 172.21.15.120:0/1653065805 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671248832 0 0) 0x7f34a80a8300 con 0x7f34a80a02e0 2024-09-18T12:57:39.990 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.987+0000 7f34a77fe640 1 --2- 172.21.15.120:0/1653065805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a809fda0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62977ca0049193a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.990 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.987+0000 7f34a67fc640 1 -- 172.21.15.120:0/1653065805 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3498009d90 con 0x7f34a809f990 2024-09-18T12:57:39.990 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.987+0000 7f34a67fc640 1 -- 172.21.15.120:0/1653065805 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f349800e230 con 0x7f34a809f990 2024-09-18T12:57:39.990 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.987+0000 7f34a67fc640 1 -- 172.21.15.120:0/1653065805 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f349800e4d0 con 0x7f34a809f990 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 1 -- 172.21.15.120:0/1653065805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 msgr2=0x7f34a809fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 1 --2- 172.21.15.120:0/1653065805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a809fda0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 1 -- 172.21.15.120:0/1653065805 shutdown_connections 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 1 --2- 172.21.15.120:0/1653065805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a809fda0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 1 -- 172.21.15.120:0/1653065805 >> 172.21.15.120:0/1653065805 conn(0x7f34a80a6390 msgr2=0x7f34a80a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 1 -- 172.21.15.120:0/1653065805 shutdown_connections 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 1 -- 172.21.15.120:0/1653065805 wait complete. 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.988+0000 7f34ae111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:39.991 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.989+0000 7f34ae111640 1 Processor -- start 2024-09-18T12:57:39.992 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.989+0000 7f34ae111640 1 -- start start 2024-09-18T12:57:39.993 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.990+0000 7f34ae111640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a81bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.993 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.990+0000 7f34ae111640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f34a81b80b0 con 0x7f34a809f990 2024-09-18T12:57:39.993 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.990+0000 7f34a77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a81bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.993 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.990+0000 7f34a77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a81bc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51648/0 (socket says 172.21.15.120:51648) 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f34a77fe640 1 -- 172.21.15.120:0/3999768053 learned_addr learned my addr 172.21.15.120:0/3999768053 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f34a77fe640 1 -- 172.21.15.120:0/3999768053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a81b8370 con 0x7f34a809f990 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f34a77fe640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a81bc2e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f348ffff640 1 -- 172.21.15.120:0/3999768053 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3498014620 con 0x7f34a809f990 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f348ffff640 1 -- 172.21.15.120:0/3999768053 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3498014780 con 0x7f34a809f990 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a81b9ae0 con 0x7f34a809f990 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f348ffff640 1 -- 172.21.15.120:0/3999768053 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3498014a20 con 0x7f34a809f990 2024-09-18T12:57:39.994 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.991+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a81ba900 con 0x7f34a809f990 2024-09-18T12:57:39.995 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.992+0000 7f348ffff640 1 -- 172.21.15.120:0/3999768053 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f3498014bd0 con 0x7f34a809f990 2024-09-18T12:57:39.995 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.992+0000 7f348ffff640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f349403e8a0 0x7f3494040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.995 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.992+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a81bbf30 con 0x7f34a809f990 2024-09-18T12:57:39.995 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.992+0000 7f348ffff640 1 -- 172.21.15.120:0/3999768053 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f3498019040 con 0x7f34a809f990 2024-09-18T12:57:39.995 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.993+0000 7f34a6ffd640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f349403e8a0 0x7f3494040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.995 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:39.993+0000 7f34a6ffd640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f349403e8a0 0x7f3494040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.138 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.136+0000 7f348ffff640 1 -- 172.21.15.120:0/3999768053 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f3498011570 con 0x7f34a809f990 2024-09-18T12:57:40.327 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.325+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34a80a3980 con 0x7f34a809f990 2024-09-18T12:57:40.328 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.326+0000 7f348ffff640 1 -- 172.21.15.120:0/3999768053 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6987 (crc 0 0 0) 0x7f34980080b0 con 0x7f34a809f990 2024-09-18T12:57:40.328 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-18T12:57:40.328 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":11,"fsid":"663d1a24-c7eb-48da-8c03-7f80c4504c0c","created":"2024-09-18T12:57:30.264061+0000","modified":"2024-09-18T12:57:39.644621+0000","last_up_change":"2024-09-18T12:57:37.580418+0000","last_in_change":"2024-09-18T12:57:32.374074+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:57:38.593562+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6801","nonce":1764758402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1764758402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1764758402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6805","nonce":1764758402}]},"public_addr":"172.21.15.120:6801/1764758402","cluster_addr":"172.21.15.120:6802/1764758402","heartbeat_back_addr":"172.21.15.120:6800/1764758402","heartbeat_front_addr":"172.21.15.120:6805/1764758402","state":["exists","up"]},{"osd":1,"uuid":"7c214373-8f9a-4112-a594-9ae4ec75bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6803","nonce":3478481720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3478481720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3478481720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6807","nonce":3478481720}]},"public_addr":"172.21.15.120:6803/3478481720","cluster_addr":"172.21.15.120:6804/3478481720","heartbeat_back_addr":"172.21.15.120:6806/3478481720","heartbeat_front_addr":"172.21.15.120:6807/3478481720","state":["exists","up"]},{"osd":2,"uuid":"40171e53-c072-4abe-9d3c-68ca18165c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1480150686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":1480150686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":1480150686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1480150686}]},"public_addr":"172.21.15.176:6802/1480150686","cluster_addr":"172.21.15.176:6803/1480150686","heartbeat_back_addr":"172.21.15.176:6809/1480150686","heartbeat_front_addr":"172.21.15.176:6808/1480150686","state":["exists","up"]},{"osd":3,"uuid":"d7aca28d-af63-4f64-8ca2-3b4c010c6e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2606993558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":2606993558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2606993558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":2606993558}]},"public_addr":"172.21.15.176:6806/2606993558","cluster_addr":"172.21.15.176:6805/2606993558","heartbeat_back_addr":"172.21.15.176:6804/2606993558","heartbeat_front_addr":"172.21.15.176:6807/2606993558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.328+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f349403e8a0 msgr2=0x7f3494040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.328+0000 7f34ae111640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f349403e8a0 0x7f3494040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.328+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 msgr2=0x7f34a81bc2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.328+0000 7f34ae111640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a81bc2e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.329+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 shutdown_connections 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.329+0000 7f34ae111640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f349403e8a0 0x7f3494040db0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.329+0000 7f34ae111640 1 --2- 172.21.15.120:0/3999768053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34a809f990 0x7f34a81bc2e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.329+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 >> 172.21.15.120:0/3999768053 conn(0x7f34a80a6390 msgr2=0x7f34a8073220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.331 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.329+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 shutdown_connections 2024-09-18T12:57:40.332 INFO:teuthology.misc.health.smithi120.stderr:2024-09-18T12:57:40.329+0000 7f34ae111640 1 -- 172.21.15.120:0/3999768053 wait complete. 2024-09-18T12:57:40.341 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-18T12:57:40.341 INFO:tasks.ceph:Creating RBD pool 2024-09-18T12:57:40.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T12:57:40.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.445+0000 7fc94b4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:40.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.454+0000 7fc94b4fd640 1 Processor -- start 2024-09-18T12:57:40.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.455+0000 7fc94b4fd640 1 -- start start 2024-09-18T12:57:40.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc94b4fd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc944135c50 0x7fc944136060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc94b4fd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9440a5840 con 0x7fc9441365a0 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc94b4fd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fc94409ca50 con 0x7fc944135c50 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc949299640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc944135c50 0x7fc944136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc948a98640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc9441365a0 0x7fc94412f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34282/0 (socket says 172.21.15.120:34282) 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc948a98640 1 -- 172.21.15.120:0/1667407074 learned_addr learned my addr 172.21.15.120:0/1667407074 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc949299640 1 -- 172.21.15.120:0/1667407074 >> v1:172.21.15.120:6789/0 conn(0x7fc9441365a0 legacy=0x7fc94412f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc949299640 1 -- 172.21.15.120:0/1667407074 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94409e0f0 con 0x7fc944135c50 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.456+0000 7fc949299640 1 --2- 172.21.15.120:0/1667407074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc944136060 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02e92a1c2820abd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.457+0000 7fc93bfff640 1 -- 172.21.15.120:0/1667407074 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc934009d90 con 0x7fc944135c50 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.457+0000 7fc93bfff640 1 -- 172.21.15.120:0/1667407074 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc93400e230 con 0x7fc944135c50 2024-09-18T12:57:40.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.457+0000 7fc93bfff640 1 -- 172.21.15.120:0/1667407074 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc93400e4d0 con 0x7fc944135c50 2024-09-18T12:57:40.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.457+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1667407074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 msgr2=0x7fc944136060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.457+0000 7fc94b4fd640 1 --2- 172.21.15.120:0/1667407074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc944136060 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.458+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1667407074 shutdown_connections 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.458+0000 7fc94b4fd640 1 --2- 172.21.15.120:0/1667407074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc944136060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.458+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1667407074 >> 172.21.15.120:0/1667407074 conn(0x7fc94409f400 msgr2=0x7fc94409f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.458+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1667407074 shutdown_connections 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.458+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1667407074 wait complete. 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.458+0000 7fc94b4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.459+0000 7fc94b4fd640 1 Processor -- start 2024-09-18T12:57:40.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.459+0000 7fc94b4fd640 1 -- start start 2024-09-18T12:57:40.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.460+0000 7fc94b4fd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc94411f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.460+0000 7fc94b4fd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc944133550 con 0x7fc944135c50 2024-09-18T12:57:40.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.460+0000 7fc949299640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc94411f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.460+0000 7fc949299640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc94411f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54984/0 (socket says 172.21.15.120:54984) 2024-09-18T12:57:40.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.460+0000 7fc949299640 1 -- 172.21.15.120:0/1769514482 learned_addr learned my addr 172.21.15.120:0/1769514482 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:40.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.461+0000 7fc949299640 1 -- 172.21.15.120:0/1769514482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440a3d10 con 0x7fc944135c50 2024-09-18T12:57:40.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.461+0000 7fc949299640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc94411f4c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.461+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc934014620 con 0x7fc944135c50 2024-09-18T12:57:40.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.461+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc934014780 con 0x7fc944135c50 2024-09-18T12:57:40.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.461+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9441234a0 con 0x7fc944135c50 2024-09-18T12:57:40.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.461+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc934014a20 con 0x7fc944135c50 2024-09-18T12:57:40.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.461+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc944120f40 con 0x7fc944135c50 2024-09-18T12:57:40.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.462+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7fc934014bd0 con 0x7fc944135c50 2024-09-18T12:57:40.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.462+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc944134930 con 0x7fc944135c50 2024-09-18T12:57:40.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.463+0000 7fc939ffb640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc92803e8a0 0x7fc928040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.463+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7fc934019040 con 0x7fc944135c50 2024-09-18T12:57:40.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.463+0000 7fc948a98640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc92803e8a0 0x7fc928040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.463+0000 7fc948a98640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc92803e8a0 0x7fc928040db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.468+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fc944134930 con 0x7fc944135c50 2024-09-18T12:57:40.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:40.650+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fc944134930 con 0x7fc944135c50 2024-09-18T12:57:41.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.344+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc93400f2a0 con 0x7fc944135c50 2024-09-18T12:57:41.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.653+0000 7fc939ffb640 1 -- 172.21.15.120:0/1769514482 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (crc 0 0 0) 0x7fc934012580 con 0x7fc944135c50 2024-09-18T12:57:41.654 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'rbd' created 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc92803e8a0 msgr2=0x7fc928040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc92803e8a0 0x7fc928040db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 msgr2=0x7fc94411f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc94411f4c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 shutdown_connections 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc92803e8a0 0x7fc928040db0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 --2- 172.21.15.120:0/1769514482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc944135c50 0x7fc94411f4c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 >> 172.21.15.120:0/1769514482 conn(0x7fc94409f400 msgr2=0x7fc944133a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:41.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 shutdown_connections 2024-09-18T12:57:41.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.657+0000 7fc94b4fd640 1 -- 172.21.15.120:0/1769514482 wait complete. 2024-09-18T12:57:41.674 DEBUG:teuthology.orchestra.run.smithi120:> rbd --cluster ceph pool init rbd 2024-09-18T12:57:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.774+0000 7feafde10ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.774+0000 7feafde10ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.775+0000 7feafde10ac0 1 Processor -- start 2024-09-18T12:57:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.775+0000 7feafde10ac0 1 -- start start 2024-09-18T12:57:41.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.776+0000 7feafde10ac0 1 --2- >> v2:172.21.15.120:3300/0 conn(0x20fbcf0 0x2198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.776+0000 7feafde10ac0 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1f60180 con 0x20fb1d0 2024-09-18T12:57:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.776+0000 7feafde10ac0 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x1f9fb90 con 0x20fbcf0 2024-09-18T12:57:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.777+0000 7feaf753d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x20fbcf0 0x2198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.777+0000 7feaf7d3e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x20fb1d0 0x20fb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34294/0 (socket says 172.21.15.120:34294) 2024-09-18T12:57:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.777+0000 7feaf7d3e640 1 -- 172.21.15.120:0/306893961 learned_addr learned my addr 172.21.15.120:0/306893961 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.777+0000 7feaf753d640 1 -- 172.21.15.120:0/306893961 >> v1:172.21.15.120:6789/0 conn(0x20fb1d0 legacy=0x20fb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.777+0000 7feaf753d640 1 -- 172.21.15.120:0/306893961 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f35f80 con 0x20fbcf0 2024-09-18T12:57:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.777+0000 7feaf6d3c640 1 -- 172.21.15.120:0/306893961 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280493632 0 0) 0x1f60180 con 0x20fb1d0 2024-09-18T12:57:41.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.778+0000 7feaf753d640 1 --2- 172.21.15.120:0/306893961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fbcf0 0x2198ce0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762e897079ca0d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.778+0000 7feaf6d3c640 1 -- 172.21.15.120:0/306893961 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feae002d7f0 con 0x20fbcf0 2024-09-18T12:57:41.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.778+0000 7feaf6d3c640 1 -- 172.21.15.120:0/306893961 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feae002d950 con 0x20fbcf0 2024-09-18T12:57:41.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.778+0000 7feaf6d3c640 1 -- 172.21.15.120:0/306893961 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feae002dbf0 con 0x20fbcf0 2024-09-18T12:57:41.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 1 -- 172.21.15.120:0/306893961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fbcf0 msgr2=0x2198ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 1 --2- 172.21.15.120:0/306893961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fbcf0 0x2198ce0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 1 -- 172.21.15.120:0/306893961 shutdown_connections 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 1 --2- 172.21.15.120:0/306893961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fbcf0 0x2198ce0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 1 -- 172.21.15.120:0/306893961 >> 172.21.15.120:0/306893961 conn(0x1f08f70 msgr2=0x20f96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 1 -- 172.21.15.120:0/306893961 shutdown_connections 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 1 -- 172.21.15.120:0/306893961 wait complete. 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.779+0000 7feafde10ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.781+0000 7feafde10ac0 1 Processor -- start 2024-09-18T12:57:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.781+0000 7feafde10ac0 1 -- start start 2024-09-18T12:57:41.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feafde10ac0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fb1d0 0x2182f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feafde10ac0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1faa8f0 con 0x20fb1d0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feaf7d3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fb1d0 0x2182f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feaf7d3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fb1d0 0x2182f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55008/0 (socket says 172.21.15.120:55008) 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feaf7d3e640 1 -- 172.21.15.120:0/1128523362 learned_addr learned my addr 172.21.15.120:0/1128523362 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feaf7d3e640 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f44800 con 0x20fb1d0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feaf7d3e640 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fb1d0 0x2182f20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feaec00be70 con 0x20fb1d0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feaec00c490 con 0x20fb1d0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1f36310 con 0x20fb1d0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feaec00c730 con 0x20fb1d0 2024-09-18T12:57:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.782+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1f35d70 con 0x20fb1d0 2024-09-18T12:57:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.783+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feaec00d040 con 0x20fb1d0 2024-09-18T12:57:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.783+0000 7feadffff640 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fead803d1c0 0x7fead803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.784+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2661+0+0 (crc 0 0 0) 0x7feaec00a040 con 0x20fb1d0 2024-09-18T12:57:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.784+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x2186dc0 con 0x20fb1d0 2024-09-18T12:57:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.784+0000 7feaf753d640 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fead803d1c0 0x7fead803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:41.784+0000 7feaf753d640 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fead803d1c0 0x7fead803f6d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.657+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 141+0+0 (crc 0 0 0) 0x7feaec006600 con 0x20fb1d0 2024-09-18T12:57:42.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.658+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x1f5d520 con 0x20fb1d0 2024-09-18T12:57:42.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.660+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7feaec00e450 con 0x20fb1d0 2024-09-18T12:57:42.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.660+0000 7feaf653b640 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7fead0002ae0 con 0x20fb1d0 2024-09-18T12:57:42.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.661+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(14..14 src has 1..14) ==== 650+0+0 (crc 0 0 0) 0x7feaec01e040 con 0x20fb1d0 2024-09-18T12:57:42.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.661+0000 7feafde10ac0 1 --2- 172.21.15.120:0/1128523362 >> v2:172.21.15.176:6806/2606993558 conn(0x20fbcf0 0x21a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.661+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x21a32e0 con 0x20fbcf0 2024-09-18T12:57:42.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.664+0000 7feaf8fa0640 1 --2- 172.21.15.120:0/1128523362 >> v2:172.21.15.176:6806/2606993558 conn(0x20fbcf0 0x21a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T12:57:42.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.695+0000 7feaf8fa0640 1 --2- 172.21.15.120:0/1128523362 >> v2:172.21.15.176:6806/2606993558 conn(0x20fbcf0 0x21a2da0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.758+0000 7feaf8fa0640 1 -- 172.21.15.120:0/1128523362 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7feae800a4b0 con 0x20fbcf0 2024-09-18T12:57:42.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.761+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x21f9ac0 con 0x20fbcf0 2024-09-18T12:57:42.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.765+0000 7feaf8fa0640 1 -- 172.21.15.120:0/1128523362 <== osd.3 v2:172.21.15.176:6806/2606993558 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feae800a4b0 con 0x20fbcf0 2024-09-18T12:57:42.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.765+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x21f95c0 con 0x20fbcf0 2024-09-18T12:57:42.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.768+0000 7feaf8fa0640 1 -- 172.21.15.120:0/1128523362 <== osd.3 v2:172.21.15.176:6806/2606993558 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feae800a4b0 con 0x20fbcf0 2024-09-18T12:57:42.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:42.768+0000 7feaf5d3a640 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fead4001f60 con 0x20fb1d0 2024-09-18T12:57:43.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:43.660+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) ==== 55+0+0 (crc 0 0 0) 0x7feaec008e40 con 0x20fb1d0 2024-09-18T12:57:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:43.660+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fead8042610 con 0x20fb1d0 2024-09-18T12:57:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:43.661+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 10 ==== osd_map(15..15 src has 1..15) ==== 626+0+0 (crc 0 0 0) 0x7feaec008930 con 0x20fb1d0 2024-09-18T12:57:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:43.661+0000 7feaf653b640 1 -- 172.21.15.120:0/1128523362 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7fead0005660 con 0x20fbcf0 2024-09-18T12:57:43.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:43.687+0000 7feaf8fa0640 1 -- 172.21.15.120:0/1128523362 <== osd.3 v2:172.21.15.176:6806/2606993558 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feae800a4b0 con 0x20fbcf0 2024-09-18T12:57:43.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:43.687+0000 7feaf5d3a640 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) -- 0x7fead4003370 con 0x20fb1d0 2024-09-18T12:57:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.667+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) ==== 43+0+0 (crc 0 0 0) 0x7feaec008e40 con 0x20fb1d0 2024-09-18T12:57:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.667+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fead8042850 con 0x20fb1d0 2024-09-18T12:57:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.667+0000 7feadffff640 1 -- 172.21.15.120:0/1128523362 <== mon.0 v2:172.21.15.120:3300/0 12 ==== osd_map(16..16 src has 1..16) ==== 654+0+0 (crc 0 0 0) 0x7feaec0083a0 con 0x20fb1d0 2024-09-18T12:57:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.667+0000 7feaf653b640 1 -- 172.21.15.120:0/1128523362 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7fead0005a40 con 0x20fbcf0 2024-09-18T12:57:44.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feaf8fa0640 1 -- 172.21.15.120:0/1128523362 <== osd.3 v2:172.21.15.176:6806/2606993558 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feae800a4b0 con 0x20fbcf0 2024-09-18T12:57:44.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 >> v2:172.21.15.176:6806/2606993558 conn(0x20fbcf0 msgr2=0x21a2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:44.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 --2- 172.21.15.120:0/1128523362 >> v2:172.21.15.176:6806/2606993558 conn(0x20fbcf0 0x21a2da0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fead803d1c0 msgr2=0x7fead803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:44.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fead803d1c0 0x7fead803f6d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fb1d0 msgr2=0x2182f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:44.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fb1d0 0x2182f20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 shutdown_connections 2024-09-18T12:57:44.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 --2- 172.21.15.120:0/1128523362 >> v2:172.21.15.176:6806/2606993558 conn(0x20fbcf0 0x21a2da0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fead803d1c0 0x7fead803f6d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 --2- 172.21.15.120:0/1128523362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x20fb1d0 0x2182f20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 >> 172.21.15.120:0/1128523362 conn(0x1f08f70 msgr2=0x217cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:44.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 shutdown_connections 2024-09-18T12:57:44.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.698+0000 7feafde10ac0 1 -- 172.21.15.120:0/1128523362 wait complete. 2024-09-18T12:57:44.704 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T12:57:44.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-18T12:57:44.705 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T12:57:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.809+0000 7f5abdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:44.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.814+0000 7f5abdd91640 1 Processor -- start 2024-09-18T12:57:44.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.815+0000 7f5abdd91640 1 -- start start 2024-09-18T12:57:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5abdd91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ab809d570 0x7f5ab813b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5abdd91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab80a0060 con 0x7f5ab809ca50 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5abdd91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab809fd30 con 0x7f5ab809d570 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5aaeffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ab809d570 0x7f5ab813b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5ab77fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5ab809ca50 0x7f5ab809ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34306/0 (socket says 172.21.15.120:34306) 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5ab77fe640 1 -- 172.21.15.120:0/4262900822 learned_addr learned my addr 172.21.15.120:0/4262900822 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5aaeffd640 1 -- 172.21.15.120:0/4262900822 >> v1:172.21.15.120:6789/0 conn(0x7f5ab809ca50 legacy=0x7f5ab809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5aaeffd640 1 -- 172.21.15.120:0/4262900822 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab809e3c0 con 0x7f5ab809d570 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5aaeffd640 1 --2- 172.21.15.120:0/4262900822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809d570 0x7f5ab813b3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e609afda73cd62c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5ab6ffd640 1 -- 172.21.15.120:0/4262900822 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5aa0009d80 con 0x7f5ab809d570 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5ab6ffd640 1 -- 172.21.15.120:0/4262900822 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5aa000e230 con 0x7f5ab809d570 2024-09-18T12:57:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.816+0000 7f5ab6ffd640 1 -- 172.21.15.120:0/4262900822 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5aa000e4d0 con 0x7f5ab809d570 2024-09-18T12:57:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 1 -- 172.21.15.120:0/4262900822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809d570 msgr2=0x7f5ab813b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 1 --2- 172.21.15.120:0/4262900822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809d570 0x7f5ab813b3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 1 -- 172.21.15.120:0/4262900822 shutdown_connections 2024-09-18T12:57:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 1 --2- 172.21.15.120:0/4262900822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809d570 0x7f5ab813b3b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 1 -- 172.21.15.120:0/4262900822 >> 172.21.15.120:0/4262900822 conn(0x7f5ab80a5230 msgr2=0x7f5ab80a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 1 -- 172.21.15.120:0/4262900822 shutdown_connections 2024-09-18T12:57:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 1 -- 172.21.15.120:0/4262900822 wait complete. 2024-09-18T12:57:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.817+0000 7f5abdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.819+0000 7f5abdd91640 1 Processor -- start 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.819+0000 7f5abdd91640 1 -- start start 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.820+0000 7f5abdd91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809ca50 0x7f5ab8122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.820+0000 7f5abdd91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab8124260 con 0x7f5ab809ca50 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.820+0000 7f5ab77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809ca50 0x7f5ab8122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.820+0000 7f5ab77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809ca50 0x7f5ab8122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55026/0 (socket says 172.21.15.120:55026) 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.820+0000 7f5ab77fe640 1 -- 172.21.15.120:0/3465859634 learned_addr learned my addr 172.21.15.120:0/3465859634 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.820+0000 7f5ab77fe640 1 -- 172.21.15.120:0/3465859634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab8126cf0 con 0x7f5ab809ca50 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.820+0000 7f5ab77fe640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809ca50 0x7f5ab8122dc0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.821+0000 7f5ab4ff9640 1 -- 172.21.15.120:0/3465859634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5aa8005a60 con 0x7f5ab809ca50 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.821+0000 7f5ab4ff9640 1 -- 172.21.15.120:0/3465859634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5aa8005bc0 con 0x7f5ab809ca50 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.821+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab81269c0 con 0x7f5ab809ca50 2024-09-18T12:57:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.821+0000 7f5ab4ff9640 1 -- 172.21.15.120:0/3465859634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5aa8005e60 con 0x7f5ab809ca50 2024-09-18T12:57:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.821+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab8126620 con 0x7f5ab809ca50 2024-09-18T12:57:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.822+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab8125120 con 0x7f5ab809ca50 2024-09-18T12:57:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.822+0000 7f5ab4ff9640 1 -- 172.21.15.120:0/3465859634 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5aa80070b0 con 0x7f5ab809ca50 2024-09-18T12:57:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.822+0000 7f5ab4ff9640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a9803e960 0x7f5a98040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.822+0000 7f5ab4ff9640 1 -- 172.21.15.120:0/3465859634 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f5aa804f680 con 0x7f5ab809ca50 2024-09-18T12:57:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.822+0000 7f5aaeffd640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a9803e960 0x7f5a98040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.823+0000 7f5aaeffd640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a9803e960 0x7f5a98040e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:44.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:44.827+0000 7f5ab4ff9640 1 -- 172.21.15.120:0/3465859634 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f5aa800dc60 con 0x7f5ab809ca50 2024-09-18T12:57:45.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.002+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5ab809ce60 con 0x7f5ab809ca50 2024-09-18T12:57:45.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.003+0000 7f5ab4ff9640 1 -- 172.21.15.120:0/3465859634 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7f5aa800d660 con 0x7f5ab809ca50 2024-09-18T12:57:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:45.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a9803e960 msgr2=0x7f5a98040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a9803e960 0x7f5a98040e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809ca50 msgr2=0x7f5ab8122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809ca50 0x7f5ab8122dc0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 shutdown_connections 2024-09-18T12:57:45.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a9803e960 0x7f5a98040e70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 --2- 172.21.15.120:0/3465859634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ab809ca50 0x7f5ab8122dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 >> 172.21.15.120:0/3465859634 conn(0x7f5ab80a5230 msgr2=0x7f5ab80a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:45.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 shutdown_connections 2024-09-18T12:57:45.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.005+0000 7f5abdd91640 1 -- 172.21.15.120:0/3465859634 wait complete. 2024-09-18T12:57:45.016 INFO:teuthology.orchestra.run.smithi120.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-18T12:57:45.017 INFO:tasks.ceph_manager:config epoch is 1 2024-09-18T12:57:45.017 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T12:57:45.017 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T12:57:45.017 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T12:57:45.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.120+0000 7fc89d4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:45.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.125+0000 7fc89d4d1640 1 Processor -- start 2024-09-18T12:57:45.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.125+0000 7fc89d4d1640 1 -- start start 2024-09-18T12:57:45.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc89d4d1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc898130250 0x7fc898137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc89d4d1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89809ddb0 con 0x7fc89812f730 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc89d4d1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fc89809dfe0 con 0x7fc898130250 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc88e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc898130250 0x7fc898137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc896ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc89812f730 0x7fc89812fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34308/0 (socket says 172.21.15.120:34308) 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc896ffd640 1 -- 172.21.15.120:0/2079132045 learned_addr learned my addr 172.21.15.120:0/2079132045 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc88e7fc640 1 -- 172.21.15.120:0/2079132045 >> v1:172.21.15.120:6789/0 conn(0x7fc89812f730 legacy=0x7fc89812fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc88e7fc640 1 -- 172.21.15.120:0/2079132045 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc898098180 con 0x7fc898130250 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc8967fc640 1 -- 172.21.15.120:0/2079132045 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114475179 0 0) 0x7fc89809ddb0 con 0x7fc89812f730 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.126+0000 7fc88e7fc640 1 --2- 172.21.15.120:0/2079132045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc898130250 0x7fc898137ec0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233f932bb8b07487 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc8967fc640 1 -- 172.21.15.120:0/2079132045 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc880009d90 con 0x7fc898130250 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc8967fc640 1 -- 172.21.15.120:0/2079132045 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc88000e230 con 0x7fc898130250 2024-09-18T12:57:45.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc8967fc640 1 -- 172.21.15.120:0/2079132045 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc88000e4d0 con 0x7fc898130250 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc89d4d1640 1 -- 172.21.15.120:0/2079132045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc898130250 msgr2=0x7fc898137ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc89d4d1640 1 --2- 172.21.15.120:0/2079132045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc898130250 0x7fc898137ec0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc89d4d1640 1 -- 172.21.15.120:0/2079132045 shutdown_connections 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc89d4d1640 1 --2- 172.21.15.120:0/2079132045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc898130250 0x7fc898137ec0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc89d4d1640 1 -- 172.21.15.120:0/2079132045 >> 172.21.15.120:0/2079132045 conn(0x7fc8980a11f0 msgr2=0x7fc8980a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc89d4d1640 1 -- 172.21.15.120:0/2079132045 shutdown_connections 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.127+0000 7fc89d4d1640 1 -- 172.21.15.120:0/2079132045 wait complete. 2024-09-18T12:57:45.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.128+0000 7fc89d4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:45.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.129+0000 7fc89d4d1640 1 Processor -- start 2024-09-18T12:57:45.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.129+0000 7fc89d4d1640 1 -- start start 2024-09-18T12:57:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.130+0000 7fc89d4d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89812f730 0x7fc89806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.130+0000 7fc89d4d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc898071660 con 0x7fc89812f730 2024-09-18T12:57:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.130+0000 7fc896ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89812f730 0x7fc89806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.130+0000 7fc896ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89812f730 0x7fc89806efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55046/0 (socket says 172.21.15.120:55046) 2024-09-18T12:57:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.130+0000 7fc896ffd640 1 -- 172.21.15.120:0/3085042326 learned_addr learned my addr 172.21.15.120:0/3085042326 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.130+0000 7fc896ffd640 1 -- 172.21.15.120:0/3085042326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89812e9e0 con 0x7fc89812f730 2024-09-18T12:57:45.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.131+0000 7fc896ffd640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89812f730 0x7fc89806efd0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.131+0000 7fc88ffff640 1 -- 172.21.15.120:0/3085042326 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc888004b80 con 0x7fc89812f730 2024-09-18T12:57:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.131+0000 7fc88ffff640 1 -- 172.21.15.120:0/3085042326 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc888004ce0 con 0x7fc89812f730 2024-09-18T12:57:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.131+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc898071850 con 0x7fc89812f730 2024-09-18T12:57:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.131+0000 7fc88ffff640 1 -- 172.21.15.120:0/3085042326 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc888007120 con 0x7fc89812f730 2024-09-18T12:57:45.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.131+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc898074dc0 con 0x7fc89812f730 2024-09-18T12:57:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.132+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89812fb40 con 0x7fc89812f730 2024-09-18T12:57:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.132+0000 7fc88ffff640 1 -- 172.21.15.120:0/3085042326 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc8880072d0 con 0x7fc89812f730 2024-09-18T12:57:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.132+0000 7fc88ffff640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc87803e930 0x7fc878040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.132+0000 7fc88ffff640 1 -- 172.21.15.120:0/3085042326 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7fc88804f750 con 0x7fc89812f730 2024-09-18T12:57:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.132+0000 7fc88e7fc640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc87803e930 0x7fc878040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.133+0000 7fc88e7fc640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc87803e930 0x7fc878040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.137+0000 7fc88ffff640 1 -- 172.21.15.120:0/3085042326 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fc88800f230 con 0x7fc89812f730 2024-09-18T12:57:45.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.358+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc898074b80 con 0x7fc89812f730 2024-09-18T12:57:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.360+0000 7fc88ffff640 1 -- 172.21.15.120:0/3085042326 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97908 (crc 0 0 0) 0x7fc88800a0c0 con 0x7fc89812f730 2024-09-18T12:57:45.362 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc87803e930 msgr2=0x7fc878040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc87803e930 0x7fc878040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89812f730 msgr2=0x7fc89806efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89812f730 0x7fc89806efd0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 shutdown_connections 2024-09-18T12:57:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc87803e930 0x7fc878040e40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 --2- 172.21.15.120:0/3085042326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89812f730 0x7fc89806efd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 >> 172.21.15.120:0/3085042326 conn(0x7fc8980a11f0 msgr2=0x7fc898132930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.362+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 shutdown_connections 2024-09-18T12:57:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.363+0000 7fc89d4d1640 1 -- 172.21.15.120:0/3085042326 wait complete. 2024-09-18T12:57:45.374 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3363408531},{"type":"v1","addr":"172.21.15.176:6801","nonce":3363408531}]},"active_addr":"172.21.15.176:6801/3363408531","active_change":"2024-09-18T12:57:34.570033+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3469898977}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":2304699671}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":2961428072}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":1504377242}]}]} 2024-09-18T12:57:45.377 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T12:57:45.377 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T12:57:45.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:57:45.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.479+0000 7f611e8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:45.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.484+0000 7f611e8d1640 1 Processor -- start 2024-09-18T12:57:45.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.484+0000 7f611e8d1640 1 -- start start 2024-09-18T12:57:45.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.485+0000 7f611e8d1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6118135c90 0x7f61181380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.485+0000 7f611e8d1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f611809f420 con 0x7f611809b470 2024-09-18T12:57:45.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.485+0000 7f611e8d1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f6118075380 con 0x7f6118135c90 2024-09-18T12:57:45.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.485+0000 7f61177fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6118135c90 0x7f61181380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.485+0000 7f6117fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f611809b470 0x7f611809b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34312/0 (socket says 172.21.15.120:34312) 2024-09-18T12:57:45.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.485+0000 7f6117fff640 1 -- 172.21.15.120:0/3759518590 learned_addr learned my addr 172.21.15.120:0/3759518590 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.486+0000 7f61177fe640 1 -- 172.21.15.120:0/3759518590 >> v1:172.21.15.120:6789/0 conn(0x7f611809b470 legacy=0x7f611809b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.486+0000 7f61177fe640 1 -- 172.21.15.120:0/3759518590 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611806d370 con 0x7f6118135c90 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.486+0000 7f61177fe640 1 --2- 172.21.15.120:0/3759518590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6118135c90 0x7f61181380b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adb9f7826192cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.486+0000 7f6116ffd640 1 -- 172.21.15.120:0/3759518590 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f610c009d90 con 0x7f6118135c90 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.486+0000 7f6116ffd640 1 -- 172.21.15.120:0/3759518590 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f610c00e230 con 0x7f6118135c90 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.486+0000 7f6116ffd640 1 -- 172.21.15.120:0/3759518590 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f610c00e4d0 con 0x7f6118135c90 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 1 -- 172.21.15.120:0/3759518590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6118135c90 msgr2=0x7f61181380b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 1 --2- 172.21.15.120:0/3759518590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6118135c90 0x7f61181380b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 1 -- 172.21.15.120:0/3759518590 shutdown_connections 2024-09-18T12:57:45.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 1 --2- 172.21.15.120:0/3759518590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6118135c90 0x7f61181380b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 1 -- 172.21.15.120:0/3759518590 >> 172.21.15.120:0/3759518590 conn(0x7f61180a32a0 msgr2=0x7f61180a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:45.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 1 -- 172.21.15.120:0/3759518590 shutdown_connections 2024-09-18T12:57:45.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 1 -- 172.21.15.120:0/3759518590 wait complete. 2024-09-18T12:57:45.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.487+0000 7f611e8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.488+0000 7f611e8d1640 1 Processor -- start 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.488+0000 7f611e8d1640 1 -- start start 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.489+0000 7f611e8d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f611809b470 0x7f61181c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.489+0000 7f611e8d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f611812e750 con 0x7f611809b470 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6117fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f611809b470 0x7f61181c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6117fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f611809b470 0x7f61181c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55058/0 (socket says 172.21.15.120:55058) 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6117fff640 1 -- 172.21.15.120:0/870765687 learned_addr learned my addr 172.21.15.120:0/870765687 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6117fff640 1 -- 172.21.15.120:0/870765687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611812c160 con 0x7f611809b470 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6117fff640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f611809b470 0x7f61181c7e80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6114ff9640 1 -- 172.21.15.120:0/870765687 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6108005a60 con 0x7f611809b470 2024-09-18T12:57:45.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6114ff9640 1 -- 172.21.15.120:0/870765687 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6108005bc0 con 0x7f611809b470 2024-09-18T12:57:45.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f6114ff9640 1 -- 172.21.15.120:0/870765687 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6108005e60 con 0x7f611809b470 2024-09-18T12:57:45.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611812fdb0 con 0x7f611809b470 2024-09-18T12:57:45.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.490+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61181c83c0 con 0x7f611809b470 2024-09-18T12:57:45.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.491+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611812ffa0 con 0x7f611809b470 2024-09-18T12:57:45.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.491+0000 7f6114ff9640 1 -- 172.21.15.120:0/870765687 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f61080070b0 con 0x7f611809b470 2024-09-18T12:57:45.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.492+0000 7f6114ff9640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f610403e930 0x7f6104040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.492+0000 7f6114ff9640 1 -- 172.21.15.120:0/870765687 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f610804f6a0 con 0x7f611809b470 2024-09-18T12:57:45.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.492+0000 7f61177fe640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f610403e930 0x7f6104040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.493+0000 7f61177fe640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f610403e930 0x7f6104040e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.497+0000 7f6114ff9640 1 -- 172.21.15.120:0/870765687 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f610800dc60 con 0x7f611809b470 2024-09-18T12:57:45.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.675+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f611809bf60 con 0x7f611809b470 2024-09-18T12:57:45.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.675+0000 7f6114ff9640 1 -- 172.21.15.120:0/870765687 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+8890 (crc 0 0 0) 0x7f610800d660 con 0x7f611809b470 2024-09-18T12:57:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:45.677 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"fsid":"663d1a24-c7eb-48da-8c03-7f80c4504c0c","created":"2024-09-18T12:57:30.264061+0000","modified":"2024-09-18T12:57:44.662644+0000","last_up_change":"2024-09-18T12:57:37.580418+0000","last_in_change":"2024-09-18T12:57:32.374074+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:57:38.593562+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T12:57:40.655372+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6801","nonce":1764758402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1764758402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1764758402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6805","nonce":1764758402}]},"public_addr":"172.21.15.120:6801/1764758402","cluster_addr":"172.21.15.120:6802/1764758402","heartbeat_back_addr":"172.21.15.120:6800/1764758402","heartbeat_front_addr":"172.21.15.120:6805/1764758402","state":["exists","up"]},{"osd":1,"uuid":"7c214373-8f9a-4112-a594-9ae4ec75bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6803","nonce":3478481720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3478481720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3478481720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6807","nonce":3478481720}]},"public_addr":"172.21.15.120:6803/3478481720","cluster_addr":"172.21.15.120:6804/3478481720","heartbeat_back_addr":"172.21.15.120:6806/3478481720","heartbeat_front_addr":"172.21.15.120:6807/3478481720","state":["exists","up"]},{"osd":2,"uuid":"40171e53-c072-4abe-9d3c-68ca18165c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1480150686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":1480150686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":1480150686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1480150686}]},"public_addr":"172.21.15.176:6802/1480150686","cluster_addr":"172.21.15.176:6803/1480150686","heartbeat_back_addr":"172.21.15.176:6809/1480150686","heartbeat_front_addr":"172.21.15.176:6808/1480150686","state":["exists","up"]},{"osd":3,"uuid":"d7aca28d-af63-4f64-8ca2-3b4c010c6e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2606993558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":2606993558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2606993558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":2606993558}]},"public_addr":"172.21.15.176:6806/2606993558","cluster_addr":"172.21.15.176:6805/2606993558","heartbeat_back_addr":"172.21.15.176:6804/2606993558","heartbeat_front_addr":"172.21.15.176:6807/2606993558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f610403e930 msgr2=0x7f6104040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f610403e930 0x7f6104040e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f611809b470 msgr2=0x7f61181c7e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f611809b470 0x7f61181c7e80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 shutdown_connections 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f610403e930 0x7f6104040e40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 --2- 172.21.15.120:0/870765687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f611809b470 0x7f61181c7e80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 >> 172.21.15.120:0/870765687 conn(0x7f61180a32a0 msgr2=0x7f6118133a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.677+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 shutdown_connections 2024-09-18T12:57:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.678+0000 7f611e8d1640 1 -- 172.21.15.120:0/870765687 wait complete. 2024-09-18T12:57:45.690 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T12:57:45.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:57:45.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.793+0000 7f08fd711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:45.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.798+0000 7f08fd711640 1 Processor -- start 2024-09-18T12:57:45.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.798+0000 7f08fd711640 1 -- start start 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08fd711640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f08f809d570 0x7f08f813b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08fd711640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f80a0060 con 0x7f08f809ca50 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08fd711640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f08f809fd30 con 0x7f08f809d570 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08effff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f08f809d570 0x7f08f813b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08effff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f08f809d570 0x7f08f813b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55066/0 (socket says 172.21.15.120:55066) 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08effff640 1 -- 172.21.15.120:0/3021205670 learned_addr learned my addr 172.21.15.120:0/3021205670 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08f6ffd640 1 --1- 172.21.15.120:0/3021205670 >> v1:172.21.15.120:6789/0 conn(0x7f08f809ca50 0x7f08f809ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34322/0 (socket says 172.21.15.120:34322) 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.799+0000 7f08effff640 1 -- 172.21.15.120:0/3021205670 >> v1:172.21.15.120:6789/0 conn(0x7f08f809ca50 legacy=0x7f08f809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.800+0000 7f08effff640 1 -- 172.21.15.120:0/3021205670 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f809e3c0 con 0x7f08f809d570 2024-09-18T12:57:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.800+0000 7f08f67fc640 1 -- 172.21.15.120:0/3021205670 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150939545 0 0) 0x7f08f80a0060 con 0x7f08f809ca50 2024-09-18T12:57:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.800+0000 7f08effff640 1 --2- 172.21.15.120:0/3021205670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809d570 0x7f08f813b3b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40689b3025aac86 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.800+0000 7f08f67fc640 1 -- 172.21.15.120:0/3021205670 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f08e0009e40 con 0x7f08f809d570 2024-09-18T12:57:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.800+0000 7f08f67fc640 1 -- 172.21.15.120:0/3021205670 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f08e000e230 con 0x7f08f809d570 2024-09-18T12:57:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.800+0000 7f08f67fc640 1 -- 172.21.15.120:0/3021205670 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f08e000e4d0 con 0x7f08f809d570 2024-09-18T12:57:45.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 1 -- 172.21.15.120:0/3021205670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809d570 msgr2=0x7f08f813b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 1 --2- 172.21.15.120:0/3021205670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809d570 0x7f08f813b3b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 1 -- 172.21.15.120:0/3021205670 shutdown_connections 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 1 --2- 172.21.15.120:0/3021205670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809d570 0x7f08f813b3b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 1 -- 172.21.15.120:0/3021205670 >> 172.21.15.120:0/3021205670 conn(0x7f08f80a5230 msgr2=0x7f08f80a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 1 -- 172.21.15.120:0/3021205670 shutdown_connections 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 1 -- 172.21.15.120:0/3021205670 wait complete. 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.801+0000 7f08fd711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.802+0000 7f08fd711640 1 Processor -- start 2024-09-18T12:57:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.802+0000 7f08fd711640 1 -- start start 2024-09-18T12:57:45.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.803+0000 7f08fd711640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809ca50 0x7f08f8126b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.803+0000 7f08fd711640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8136db0 con 0x7f08f809ca50 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.803+0000 7f08f6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809ca50 0x7f08f8126b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.803+0000 7f08f6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809ca50 0x7f08f8126b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55072/0 (socket says 172.21.15.120:55072) 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.803+0000 7f08f6ffd640 1 -- 172.21.15.120:0/2928590893 learned_addr learned my addr 172.21.15.120:0/2928590893 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.804+0000 7f08f6ffd640 1 -- 172.21.15.120:0/2928590893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f8125450 con 0x7f08f809ca50 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.804+0000 7f08f6ffd640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809ca50 0x7f08f8126b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.804+0000 7f08ef7fe640 1 -- 172.21.15.120:0/2928590893 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f08e8004b80 con 0x7f08f809ca50 2024-09-18T12:57:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.804+0000 7f08ef7fe640 1 -- 172.21.15.120:0/2928590893 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f08e8004ce0 con 0x7f08f809ca50 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.804+0000 7f08ef7fe640 1 -- 172.21.15.120:0/2928590893 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f08e8007120 con 0x7f08f809ca50 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.804+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f8124ba0 con 0x7f08f809ca50 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.804+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f8126270 con 0x7f08f809ca50 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.805+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f80a1ba0 con 0x7f08f809ca50 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.805+0000 7f08ef7fe640 1 -- 172.21.15.120:0/2928590893 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f08e80072d0 con 0x7f08f809ca50 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.805+0000 7f08ef7fe640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f08d803e930 0x7f08d8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.805+0000 7f08ef7fe640 1 -- 172.21.15.120:0/2928590893 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f08e804f7e0 con 0x7f08f809ca50 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.806+0000 7f08effff640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f08d803e930 0x7f08d8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:45.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.806+0000 7f08effff640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f08d803e930 0x7f08d8040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:45.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.810+0000 7f08ef7fe640 1 -- 172.21.15.120:0/2928590893 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f08e800f230 con 0x7f08f809ca50 2024-09-18T12:57:45.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.987+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08f809ce60 con 0x7f08f809ca50 2024-09-18T12:57:45.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.988+0000 7f08ef7fe640 1 -- 172.21.15.120:0/2928590893 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+8890 (crc 0 0 0) 0x7f08e8006740 con 0x7f08f809ca50 2024-09-18T12:57:45.989 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:45.989 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"fsid":"663d1a24-c7eb-48da-8c03-7f80c4504c0c","created":"2024-09-18T12:57:30.264061+0000","modified":"2024-09-18T12:57:44.662644+0000","last_up_change":"2024-09-18T12:57:37.580418+0000","last_in_change":"2024-09-18T12:57:32.374074+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:57:38.593562+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T12:57:40.655372+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6801","nonce":1764758402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1764758402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1764758402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6805","nonce":1764758402}]},"public_addr":"172.21.15.120:6801/1764758402","cluster_addr":"172.21.15.120:6802/1764758402","heartbeat_back_addr":"172.21.15.120:6800/1764758402","heartbeat_front_addr":"172.21.15.120:6805/1764758402","state":["exists","up"]},{"osd":1,"uuid":"7c214373-8f9a-4112-a594-9ae4ec75bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6803","nonce":3478481720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3478481720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3478481720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6807","nonce":3478481720}]},"public_addr":"172.21.15.120:6803/3478481720","cluster_addr":"172.21.15.120:6804/3478481720","heartbeat_back_addr":"172.21.15.120:6806/3478481720","heartbeat_front_addr":"172.21.15.120:6807/3478481720","state":["exists","up"]},{"osd":2,"uuid":"40171e53-c072-4abe-9d3c-68ca18165c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1480150686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":1480150686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":1480150686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1480150686}]},"public_addr":"172.21.15.176:6802/1480150686","cluster_addr":"172.21.15.176:6803/1480150686","heartbeat_back_addr":"172.21.15.176:6809/1480150686","heartbeat_front_addr":"172.21.15.176:6808/1480150686","state":["exists","up"]},{"osd":3,"uuid":"d7aca28d-af63-4f64-8ca2-3b4c010c6e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2606993558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":2606993558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2606993558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":2606993558}]},"public_addr":"172.21.15.176:6806/2606993558","cluster_addr":"172.21.15.176:6805/2606993558","heartbeat_back_addr":"172.21.15.176:6804/2606993558","heartbeat_front_addr":"172.21.15.176:6807/2606993558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f08d803e930 msgr2=0x7f08d8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f08d803e930 0x7f08d8040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809ca50 msgr2=0x7f08f8126b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809ca50 0x7f08f8126b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 shutdown_connections 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f08d803e930 0x7f08d8040e40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 --2- 172.21.15.120:0/2928590893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08f809ca50 0x7f08f8126b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:45.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.990+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 >> 172.21.15.120:0/2928590893 conn(0x7f08f80a5230 msgr2=0x7f08f80a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:45.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.991+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 shutdown_connections 2024-09-18T12:57:45.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:45.991+0000 7f08fd711640 1 -- 172.21.15.120:0/2928590893 wait complete. 2024-09-18T12:57:46.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T12:57:46.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T12:57:46.004 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T12:57:46.004 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T12:57:46.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.116+0000 7f46bbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.116+0000 7f4e596fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.122+0000 7f46bbd91640 1 Processor -- start 2024-09-18T12:57:46.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.122+0000 7f4e596fd640 1 Processor -- start 2024-09-18T12:57:46.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.122+0000 7f46bbd91640 1 -- start start 2024-09-18T12:57:46.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.122+0000 7f4e596fd640 1 -- start start 2024-09-18T12:57:46.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.123+0000 7f4e596fd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e5412f180 0x7f4e5412f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.123+0000 7f46bbd91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f46b409d570 0x7f46b413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.123+0000 7f46bbd91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b40a0060 con 0x7f46b409ca50 2024-09-18T12:57:46.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.123+0000 7f46bbd91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f46b409fd30 con 0x7f46b409d570 2024-09-18T12:57:46.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e596fd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e5406dbc0 con 0x7f4e54132150 2024-09-18T12:57:46.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e596fd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f4e5406f140 con 0x7f4e5412f180 2024-09-18T12:57:46.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e52ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e5412f180 0x7f4e5412f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e52ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e5412f180 0x7f4e5412f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55094/0 (socket says 172.21.15.120:55094) 2024-09-18T12:57:46.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e52ffd640 1 -- 172.21.15.120:0/3891686475 learned_addr learned my addr 172.21.15.120:0/3891686475 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b932c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f46b409d570 0x7f46b413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b932c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f46b409d570 0x7f46b413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55084/0 (socket says 172.21.15.120:55084) 2024-09-18T12:57:46.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b932c640 1 -- 172.21.15.120:0/2853435962 learned_addr learned my addr 172.21.15.120:0/2853435962 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b9b2d640 1 --1- 172.21.15.120:0/2853435962 >> v1:172.21.15.120:6789/0 conn(0x7f46b409ca50 0x7f46b409ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34338/0 (socket says 172.21.15.120:34338) 2024-09-18T12:57:46.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b932c640 1 -- 172.21.15.120:0/2853435962 >> v1:172.21.15.120:6789/0 conn(0x7f46b409ca50 legacy=0x7f46b409ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b932c640 1 -- 172.21.15.120:0/2853435962 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b409e3c0 con 0x7f46b409d570 2024-09-18T12:57:46.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e52ffd640 1 -- 172.21.15.120:0/3891686475 >> v1:172.21.15.120:6789/0 conn(0x7f4e54132150 legacy=0x7f4e54132560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e52ffd640 1 -- 172.21.15.120:0/3891686475 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e54072da0 con 0x7f4e5412f180 2024-09-18T12:57:46.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b932c640 1 --2- 172.21.15.120:0/2853435962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409d570 0x7f46b413b3b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd49b2780da5ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f4e52ffd640 1 --2- 172.21.15.120:0/3891686475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412f590 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f343899a60f3a1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.124+0000 7f46b8b2b640 1 -- 172.21.15.120:0/2853435962 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46a4009e40 con 0x7f46b409d570 2024-09-18T12:57:46.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f46b8b2b640 1 -- 172.21.15.120:0/2853435962 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46a400e230 con 0x7f46b409d570 2024-09-18T12:57:46.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f46b8b2b640 1 -- 172.21.15.120:0/2853435962 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46a400e4d0 con 0x7f46b409d570 2024-09-18T12:57:46.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f4e51ffb640 1 -- 172.21.15.120:0/3891686475 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e4400d580 con 0x7f4e5412f180 2024-09-18T12:57:46.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f4e51ffb640 1 -- 172.21.15.120:0/3891686475 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4e4400d6e0 con 0x7f4e5412f180 2024-09-18T12:57:46.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f4e51ffb640 1 -- 172.21.15.120:0/3891686475 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e4400d980 con 0x7f4e5412f180 2024-09-18T12:57:46.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f46bbd91640 1 -- 172.21.15.120:0/2853435962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409d570 msgr2=0x7f46b413b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2853435962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409d570 0x7f46b413b3b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f46bbd91640 1 -- 172.21.15.120:0/2853435962 shutdown_connections 2024-09-18T12:57:46.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f4e596fd640 1 -- 172.21.15.120:0/3891686475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 msgr2=0x7f4e5412f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f4e596fd640 1 --2- 172.21.15.120:0/3891686475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412f590 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2853435962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409d570 0x7f46b413b3b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.125+0000 7f46bbd91640 1 -- 172.21.15.120:0/2853435962 >> 172.21.15.120:0/2853435962 conn(0x7f46b40a5230 msgr2=0x7f46b40a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f4e596fd640 1 -- 172.21.15.120:0/3891686475 shutdown_connections 2024-09-18T12:57:46.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f4e596fd640 1 --2- 172.21.15.120:0/3891686475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412f590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f4e596fd640 1 -- 172.21.15.120:0/3891686475 >> 172.21.15.120:0/3891686475 conn(0x7f4e540a33b0 msgr2=0x7f4e540a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f46bbd91640 1 -- 172.21.15.120:0/2853435962 shutdown_connections 2024-09-18T12:57:46.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f4e596fd640 1 -- 172.21.15.120:0/3891686475 shutdown_connections 2024-09-18T12:57:46.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f4e596fd640 1 -- 172.21.15.120:0/3891686475 wait complete. 2024-09-18T12:57:46.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f46bbd91640 1 -- 172.21.15.120:0/2853435962 wait complete. 2024-09-18T12:57:46.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f4e596fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.126+0000 7f46bbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.116+0000 7f830a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.116+0000 7fcf8c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.127+0000 7f46bbd91640 1 Processor -- start 2024-09-18T12:57:46.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.127+0000 7f46bbd91640 1 -- start start 2024-09-18T12:57:46.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.127+0000 7f4e596fd640 1 Processor -- start 2024-09-18T12:57:46.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7f4e596fd640 1 -- start start 2024-09-18T12:57:46.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7f830a591640 1 Processor -- start 2024-09-18T12:57:46.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7f830a591640 1 -- start start 2024-09-18T12:57:46.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7fcf8c591640 1 Processor -- start 2024-09-18T12:57:46.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7fcf8c591640 1 -- start start 2024-09-18T12:57:46.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7f46bbd91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409ca50 0x7f46b4122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7f46bbd91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4124260 con 0x7f46b409ca50 2024-09-18T12:57:46.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.128+0000 7f46b9b2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409ca50 0x7f46b4122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46b9b2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409ca50 0x7f46b4122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55106/0 (socket says 172.21.15.120:55106) 2024-09-18T12:57:46.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46b9b2d640 1 -- 172.21.15.120:0/2449564451 learned_addr learned my addr 172.21.15.120:0/2449564451 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f4e596fd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f4e596fd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5411d9b0 con 0x7f4e5412f180 2024-09-18T12:57:46.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f4e52ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46b9b2d640 1 -- 172.21.15.120:0/2449564451 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b4126cf0 con 0x7f46b409ca50 2024-09-18T12:57:46.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f4e52ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55116/0 (socket says 172.21.15.120:55116) 2024-09-18T12:57:46.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f4e52ffd640 1 -- 172.21.15.120:0/1197462987 learned_addr learned my addr 172.21.15.120:0/1197462987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f830a591640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f830409d570 0x7f830413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46b9b2d640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409ca50 0x7f46b4122dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f830a591640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83040a0060 con 0x7f830409ca50 2024-09-18T12:57:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f830a591640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f830409fd30 con 0x7f830409d570 2024-09-18T12:57:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f83037fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f830409d570 0x7f830413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f83037fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f830409d570 0x7f830413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55124/0 (socket says 172.21.15.120:55124) 2024-09-18T12:57:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f83037fe640 1 -- 172.21.15.120:0/1820357139 learned_addr learned my addr 172.21.15.120:0/1820357139 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46b00059a0 con 0x7f46b409ca50 2024-09-18T12:57:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46b0005b00 con 0x7f46b409ca50 2024-09-18T12:57:46.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46b0005da0 con 0x7f46b409ca50 2024-09-18T12:57:46.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f83037fe640 1 -- 172.21.15.120:0/1820357139 >> v1:172.21.15.120:6789/0 conn(0x7f830409ca50 legacy=0x7f830409ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.129+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41269c0 con 0x7f46b409ca50 2024-09-18T12:57:46.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f83037fe640 1 -- 172.21.15.120:0/1820357139 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830409e3c0 con 0x7f830409d570 2024-09-18T12:57:46.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f4e52ffd640 1 -- 172.21.15.120:0/1197462987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5411f010 con 0x7f4e5412f180 2024-09-18T12:57:46.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7fcf8c591640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcf8412dbd0 0x7fcf84138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7fcf8c591640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf8406d370 con 0x7fcf8409d730 2024-09-18T12:57:46.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f83037fe640 1 --2- 172.21.15.120:0/1820357139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409d570 0x7f830413b3b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c11ae2029385bef server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7fcf89b2c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcf8412dbd0 0x7fcf84138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7fcf89b2c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcf8412dbd0 0x7fcf84138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55136/0 (socket says 172.21.15.120:55136) 2024-09-18T12:57:46.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b4126620 con 0x7f46b409ca50 2024-09-18T12:57:46.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7fcf89b2c640 1 -- 172.21.15.120:0/2230106725 learned_addr learned my addr 172.21.15.120:0/2230106725 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7fcf8c591640 1 -- 172.21.15.120:0/2230106725 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcf8409e960 con 0x7fcf8412dbd0 2024-09-18T12:57:46.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f8302ffd640 1 -- 172.21.15.120:0/1820357139 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f8009da0 con 0x7f830409d570 2024-09-18T12:57:46.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f8302ffd640 1 -- 172.21.15.120:0/1820357139 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82f800e230 con 0x7f830409d570 2024-09-18T12:57:46.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f8302ffd640 1 -- 172.21.15.120:0/1820357139 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f800e4d0 con 0x7f830409d570 2024-09-18T12:57:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f4e52ffd640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412e050 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e4400c8d0 con 0x7f4e5412f180 2024-09-18T12:57:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4e4400ca30 con 0x7f4e5412f180 2024-09-18T12:57:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5411f8c0 con 0x7f4e5412f180 2024-09-18T12:57:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e4400c8d0 con 0x7f4e5412f180 2024-09-18T12:57:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.130+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e54120980 con 0x7f4e5412f180 2024-09-18T12:57:46.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46b409f9b0 con 0x7f46b409ca50 2024-09-18T12:57:46.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7fcf8932b640 1 -- 172.21.15.120:0/2230106725 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391606556 0 0) 0x7fcf8406d370 con 0x7fcf8409d730 2024-09-18T12:57:46.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7fcf8932b640 1 -- 172.21.15.120:0/2230106725 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf70003580 con 0x7fcf8409d730 2024-09-18T12:57:46.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f46b00070b0 con 0x7f46b409ca50 2024-09-18T12:57:46.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7fcf89b2c640 1 -- 172.21.15.120:0/2230106725 >> v1:172.21.15.120:6789/0 conn(0x7fcf8409d730 legacy=0x7fcf8412d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7fcf89b2c640 1 -- 172.21.15.120:0/2230106725 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8409e650 con 0x7fcf8412dbd0 2024-09-18T12:57:46.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7f830a591640 1 -- 172.21.15.120:0/1820357139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409d570 msgr2=0x7f830413b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.131+0000 7f830a591640 1 --2- 172.21.15.120:0/1820357139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409d570 0x7f830413b3b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f830a591640 1 -- 172.21.15.120:0/1820357139 shutdown_connections 2024-09-18T12:57:46.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f830a591640 1 --2- 172.21.15.120:0/1820357139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409d570 0x7f830413b3b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f830a591640 1 -- 172.21.15.120:0/1820357139 >> 172.21.15.120:0/1820357139 conn(0x7f83040a5230 msgr2=0x7f83040a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f830a591640 1 -- 172.21.15.120:0/1820357139 shutdown_connections 2024-09-18T12:57:46.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4e44015040 con 0x7f4e5412f180 2024-09-18T12:57:46.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f830a591640 1 -- 172.21.15.120:0/1820357139 wait complete. 2024-09-18T12:57:46.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f46aa7fc640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f469803ea00 0x7f4698040f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f46b004f6f0 con 0x7f46b409ca50 2024-09-18T12:57:46.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7fcf89b2c640 1 --2- 172.21.15.120:0/2230106725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8412dbd0 0x7fcf84138d40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8500c4f9d706f097 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e5411d840 con 0x7f4e5412f180 2024-09-18T12:57:46.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f830a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f46aa7fc640 1 --2- 172.21.15.120:0/2449564451 >> v2:172.21.15.176:6802/1480150686 conn(0x7f4698043a00 0x7f4698045ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7fcf8932b640 1 -- 172.21.15.120:0/2230106725 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf74009e50 con 0x7fcf8412dbd0 2024-09-18T12:57:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 --> v2:172.21.15.176:6802/1480150686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4698046560 con 0x7f4698043a00 2024-09-18T12:57:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (crc 0 0 0) 0x7f46b000f230 con 0x7f46b409ca50 2024-09-18T12:57:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e3b7fe640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4e40047130 0x7f4e40049640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7fcf8932b640 1 -- 172.21.15.120:0/2230106725 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcf7400e230 con 0x7fcf8412dbd0 2024-09-18T12:57:46.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7fcf8932b640 1 -- 172.21.15.120:0/2230106725 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf7400e4d0 con 0x7fcf8412dbd0 2024-09-18T12:57:46.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f46b932c640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f469803ea00 0x7f4698040f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f4e44012040 con 0x7f4e5412f180 2024-09-18T12:57:46.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e527fc640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4e40047130 0x7f4e40049640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e3b7fe640 1 --2- 172.21.15.120:0/1197462987 >> v2:172.21.15.120:6801/1764758402 conn(0x7f4e4004c130 0x7f4e4004e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 --> v2:172.21.15.120:6801/1764758402 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e4004ec90 con 0x7f4e4004c130 2024-09-18T12:57:46.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.132+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (crc 0 0 0) 0x7f4e44050e40 con 0x7f4e5412f180 2024-09-18T12:57:46.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.133+0000 7f4e527fc640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4e40047130 0x7f4e40049640 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.133+0000 7f46b932c640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f469803ea00 0x7f4698040f10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.133+0000 7f46ba32e640 1 --2- 172.21.15.120:0/2449564451 >> v2:172.21.15.176:6802/1480150686 conn(0x7f4698043a00 0x7f4698045ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T12:57:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.133+0000 7fcf8c591640 1 -- 172.21.15.120:0/2230106725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8412dbd0 msgr2=0x7fcf84138d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.133+0000 7fcf8c591640 1 --2- 172.21.15.120:0/2230106725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8412dbd0 0x7fcf84138d40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7fcf8c591640 1 -- 172.21.15.120:0/2230106725 shutdown_connections 2024-09-18T12:57:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7fcf8c591640 1 --2- 172.21.15.120:0/2230106725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8412dbd0 0x7fcf84138d40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7fcf8c591640 1 -- 172.21.15.120:0/2230106725 >> 172.21.15.120:0/2230106725 conn(0x7fcf840a1490 msgr2=0x7fcf840a18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7f4e537fe640 1 --2- 172.21.15.120:0/1197462987 >> v2:172.21.15.120:6801/1764758402 conn(0x7f4e4004c130 0x7f4e4004e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T12:57:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7f830a591640 1 Processor -- start 2024-09-18T12:57:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7f830a591640 1 -- start start 2024-09-18T12:57:46.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7fcf8c591640 1 -- 172.21.15.120:0/2230106725 shutdown_connections 2024-09-18T12:57:46.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.134+0000 7fcf8c591640 1 -- 172.21.15.120:0/2230106725 wait complete. 2024-09-18T12:57:46.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.135+0000 7fcf8c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.136+0000 7f830a591640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409ca50 0x7f8304123e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.136+0000 7f8303fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409ca50 0x7f8304123e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.136+0000 7f8303fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409ca50 0x7f8304123e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55148/0 (socket says 172.21.15.120:55148) 2024-09-18T12:57:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.136+0000 7f8303fff640 1 -- 172.21.15.120:0/2603749508 learned_addr learned my addr 172.21.15.120:0/2603749508 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.136+0000 7f830a591640 1 -- 172.21.15.120:0/2603749508 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f83041257f0 con 0x7f830409ca50 2024-09-18T12:57:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7f8303fff640 1 -- 172.21.15.120:0/2603749508 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8304136c40 con 0x7f830409ca50 2024-09-18T12:57:46.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7fcf8c591640 1 Processor -- start 2024-09-18T12:57:46.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7fcf8c591640 1 -- start start 2024-09-18T12:57:46.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7f8303fff640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409ca50 0x7f8304123e30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f40051e0 con 0x7f830409ca50 2024-09-18T12:57:46.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82f4005340 con 0x7f830409ca50 2024-09-18T12:57:46.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7f830a591640 1 -- 172.21.15.120:0/2603749508 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83041260a0 con 0x7f830409ca50 2024-09-18T12:57:46.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f400c750 con 0x7f830409ca50 2024-09-18T12:57:46.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.137+0000 7f830a591640 1 -- 172.21.15.120:0/2603749508 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8304127190 con 0x7f830409ca50 2024-09-18T12:57:46.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.138+0000 7f46ba32e640 1 --2- 172.21.15.120:0/2449564451 >> v2:172.21.15.176:6802/1480150686 conn(0x7f4698043a00 0x7f4698045ed0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.138+0000 7f830a591640 1 -- 172.21.15.120:0/2603749508 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f830409f9b0 con 0x7f830409ca50 2024-09-18T12:57:46.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.138+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f82f400c950 con 0x7f830409ca50 2024-09-18T12:57:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7fcf8c591640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8409d730 0x7fcf8412c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7fcf8c591640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcf84137df0 con 0x7fcf8409d730 2024-09-18T12:57:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7f8300ff9640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f82f003e8e0 0x7f82f0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7fcf8a32d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8409d730 0x7fcf8412c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f82f404f720 con 0x7f830409ca50 2024-09-18T12:57:46.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7fcf8a32d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8409d730 0x7fcf8412c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55154/0 (socket says 172.21.15.120:55154) 2024-09-18T12:57:46.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7fcf8a32d640 1 -- 172.21.15.120:0/621267687 learned_addr learned my addr 172.21.15.120:0/621267687 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7f8300ff9640 1 --2- 172.21.15.120:0/2603749508 >> v2:172.21.15.176:6806/2606993558 conn(0x7f82f00438e0 0x7f82f0045db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 --> v2:172.21.15.176:6806/2606993558 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82f0046440 con 0x7f82f00438e0 2024-09-18T12:57:46.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (crc 0 0 0) 0x7f82f4051c10 con 0x7f830409ca50 2024-09-18T12:57:46.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7f83037fe640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f82f003e8e0 0x7f82f0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7fcf8a32d640 1 -- 172.21.15.120:0/621267687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf84138020 con 0x7fcf8409d730 2024-09-18T12:57:46.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7f4e537fe640 1 --2- 172.21.15.120:0/1197462987 >> v2:172.21.15.120:6801/1764758402 conn(0x7f4e4004c130 0x7f4e4004e600 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.139+0000 7fcf8a32d640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8409d730 0x7fcf8412c3e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.140+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf800051e0 con 0x7fcf8409d730 2024-09-18T12:57:46.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.140+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcf80005340 con 0x7fcf8409d730 2024-09-18T12:57:46.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.140+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf8000c730 con 0x7fcf8409d730 2024-09-18T12:57:46.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.140+0000 7fcf8c591640 1 -- 172.21.15.120:0/621267687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf84137ad0 con 0x7fcf8409d730 2024-09-18T12:57:46.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.140+0000 7f83037fe640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f82f003e8e0 0x7f82f0040df0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.140+0000 7fcf8c591640 1 -- 172.21.15.120:0/621267687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8411ba80 con 0x7fcf8409d730 2024-09-18T12:57:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.140+0000 7f8308b2e640 1 --2- 172.21.15.120:0/2603749508 >> v2:172.21.15.176:6806/2606993558 conn(0x7f82f00438e0 0x7f82f0045db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T12:57:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== osd.2 v2:172.21.15.176:6802/1480150686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f4698046560 con 0x7f4698043a00 2024-09-18T12:57:46.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcf8000c890 con 0x7fcf8409d730 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf8c591640 1 -- 172.21.15.120:0/621267687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf8409cb00 con 0x7fcf8409d730 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf7affd640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcf6803e980 0x7fcf68040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7fcf8004f690 con 0x7fcf8409d730 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf7affd640 1 --2- 172.21.15.120:0/621267687 >> v2:172.21.15.120:6803/3478481720 conn(0x7fcf68043980 0x7fcf68045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 --> v2:172.21.15.120:6803/3478481720 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf680464e0 con 0x7fcf68043980 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (crc 0 0 0) 0x7fcf8004f9d0 con 0x7fcf8409d730 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.141+0000 7fcf89b2c640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcf6803e980 0x7fcf68040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.142+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f4e4004ec90 con 0x7f4e4004c130 2024-09-18T12:57:46.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.142+0000 7fcf8ab2e640 1 --2- 172.21.15.120:0/621267687 >> v2:172.21.15.120:6803/3478481720 conn(0x7fcf68043980 0x7fcf68045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T12:57:46.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.144+0000 7fcf89b2c640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcf6803e980 0x7fcf68040e90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.145+0000 7f8308b2e640 1 --2- 172.21.15.120:0/2603749508 >> v2:172.21.15.176:6806/2606993558 conn(0x7f82f00438e0 0x7f82f0045db0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.145+0000 7fcf8ab2e640 1 --2- 172.21.15.120:0/621267687 >> v2:172.21.15.120:6803/3478481720 conn(0x7fcf68043980 0x7fcf68045e50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.146+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== osd.1 v2:172.21.15.120:6803/3478481720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fcf680464e0 con 0x7fcf68043980 2024-09-18T12:57:46.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.147+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f82f0046440 con 0x7f82f00438e0 2024-09-18T12:57:46.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.148+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 --> v2:172.21.15.176:6802/1480150686 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46b4125120 con 0x7f4698043a00 2024-09-18T12:57:46.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.148+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 --> v2:172.21.15.120:6801/1764758402 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e540a1e40 con 0x7f4e4004c130 2024-09-18T12:57:46.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.149+0000 7f46aa7fc640 1 -- 172.21.15.120:0/2449564451 <== osd.2 v2:172.21.15.176:6802/1480150686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46b4125120 con 0x7f4698043a00 2024-09-18T12:57:46.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.149+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 >> v2:172.21.15.176:6802/1480150686 conn(0x7f4698043a00 msgr2=0x7f4698045ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.149+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2449564451 >> v2:172.21.15.176:6802/1480150686 conn(0x7f4698043a00 0x7f4698045ed0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f469803ea00 msgr2=0x7f4698040f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f469803ea00 0x7f4698040f10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409ca50 msgr2=0x7f46b4122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409ca50 0x7f46b4122dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 shutdown_connections 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2449564451 >> v2:172.21.15.176:6802/1480150686 conn(0x7f4698043a00 0x7f4698045ed0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f469803ea00 0x7f4698040f10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 --2- 172.21.15.120:0/2449564451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b409ca50 0x7f46b4122dc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 >> 172.21.15.120:0/2449564451 conn(0x7f46b40a5230 msgr2=0x7f46b40a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 shutdown_connections 2024-09-18T12:57:46.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f46bbd91640 1 -- 172.21.15.120:0/2449564451 wait complete. 2024-09-18T12:57:46.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.150+0000 7f830a591640 1 -- 172.21.15.120:0/2603749508 --> v2:172.21.15.176:6806/2606993558 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8304127d70 con 0x7f82f00438e0 2024-09-18T12:57:46.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e3b7fe640 1 -- 172.21.15.120:0/1197462987 <== osd.0 v2:172.21.15.120:6801/1764758402 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4e4c00a820 con 0x7f4e4004c130 2024-09-18T12:57:46.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 >> v2:172.21.15.120:6801/1764758402 conn(0x7f4e4004c130 msgr2=0x7f4e4004e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 --2- 172.21.15.120:0/1197462987 >> v2:172.21.15.120:6801/1764758402 conn(0x7f4e4004c130 0x7f4e4004e600 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4e40047130 msgr2=0x7f4e40049640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4e40047130 0x7f4e40049640 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7fcf8c591640 1 -- 172.21.15.120:0/621267687 --> v2:172.21.15.120:6803/3478481720 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf8412d4c0 con 0x7fcf68043980 2024-09-18T12:57:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 msgr2=0x7f4e5412e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412e050 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 shutdown_connections 2024-09-18T12:57:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 --2- 172.21.15.120:0/1197462987 >> v2:172.21.15.120:6801/1764758402 conn(0x7f4e4004c130 0x7f4e4004e600 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4e40047130 0x7f4e40049640 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 --2- 172.21.15.120:0/1197462987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e5412f180 0x7f4e5412e050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 >> 172.21.15.120:0/1197462987 conn(0x7f4e540a33b0 msgr2=0x7f4e5409d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.151+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 shutdown_connections 2024-09-18T12:57:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.152+0000 7f4e596fd640 1 -- 172.21.15.120:0/1197462987 wait complete. 2024-09-18T12:57:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.152+0000 7f8300ff9640 1 -- 172.21.15.120:0/2603749508 <== osd.3 v2:172.21.15.176:6806/2606993558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8304127d70 con 0x7f82f00438e0 2024-09-18T12:57:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 -- 172.21.15.120:0/2603749508 >> v2:172.21.15.176:6806/2606993558 conn(0x7f82f00438e0 msgr2=0x7f82f0045db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 --2- 172.21.15.120:0/2603749508 >> v2:172.21.15.176:6806/2606993558 conn(0x7f82f00438e0 0x7f82f0045db0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 -- 172.21.15.120:0/2603749508 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f82f003e8e0 msgr2=0x7f82f0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f82f003e8e0 0x7f82f0040df0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 -- 172.21.15.120:0/2603749508 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409ca50 msgr2=0x7f8304123e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409ca50 0x7f8304123e30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7fcf7affd640 1 -- 172.21.15.120:0/621267687 <== osd.1 v2:172.21.15.120:6803/3478481720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf8412d4c0 con 0x7fcf68043980 2024-09-18T12:57:46.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 -- 172.21.15.120:0/2603749508 shutdown_connections 2024-09-18T12:57:46.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 --2- 172.21.15.120:0/2603749508 >> v2:172.21.15.176:6806/2606993558 conn(0x7f82f00438e0 0x7f82f0045db0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f82f003e8e0 0x7f82f0040df0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 --2- 172.21.15.120:0/2603749508 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f830409ca50 0x7f8304123e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7f82ea7fc640 1 -- 172.21.15.120:0/2603749508 >> 172.21.15.120:0/2603749508 conn(0x7f83040a5230 msgr2=0x7f83040a1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.153+0000 7fcf78ff9640 1 -- 172.21.15.120:0/621267687 >> v2:172.21.15.120:6803/3478481720 conn(0x7fcf68043980 msgr2=0x7fcf68045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 --2- 172.21.15.120:0/621267687 >> v2:172.21.15.120:6803/3478481720 conn(0x7fcf68043980 0x7fcf68045e50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7f82ea7fc640 1 -- 172.21.15.120:0/2603749508 shutdown_connections 2024-09-18T12:57:46.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7f82ea7fc640 1 -- 172.21.15.120:0/2603749508 wait complete. 2024-09-18T12:57:46.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 -- 172.21.15.120:0/621267687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcf6803e980 msgr2=0x7fcf68040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcf6803e980 0x7fcf68040e90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 -- 172.21.15.120:0/621267687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8409d730 msgr2=0x7fcf8412c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8409d730 0x7fcf8412c3e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 -- 172.21.15.120:0/621267687 shutdown_connections 2024-09-18T12:57:46.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 --2- 172.21.15.120:0/621267687 >> v2:172.21.15.120:6803/3478481720 conn(0x7fcf68043980 0x7fcf68045e50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcf6803e980 0x7fcf68040e90 crc :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 --2- 172.21.15.120:0/621267687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf8409d730 0x7fcf8412c3e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 -- 172.21.15.120:0/621267687 >> 172.21.15.120:0/621267687 conn(0x7fcf840a1490 msgr2=0x7fcf84073b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 -- 172.21.15.120:0/621267687 shutdown_connections 2024-09-18T12:57:46.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.154+0000 7fcf78ff9640 1 -- 172.21.15.120:0/621267687 wait complete. 2024-09-18T12:57:46.192 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T12:57:46.193 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T12:57:46.194 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.194 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T12:57:46.195 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T12:57:46.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.346+0000 7fcba7d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.346+0000 7ff62ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.352+0000 7fcba7d51640 1 Processor -- start 2024-09-18T12:57:46.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.352+0000 7ff62ed51640 1 Processor -- start 2024-09-18T12:57:46.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.352+0000 7ff62ed51640 1 -- start start 2024-09-18T12:57:46.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.352+0000 7fcba7d51640 1 -- start start 2024-09-18T12:57:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.353+0000 7ff62ed51640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff62809e620 0x7ff628139490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.353+0000 7ff62ed51640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62809ed40 con 0x7ff62809db00 2024-09-18T12:57:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7ff62ed51640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff62809ea30 con 0x7ff62809e620 2024-09-18T12:57:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.353+0000 7fcba7d51640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcba0138fd0 0x7fcba013b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba7d51640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba0136c10 con 0x7fcba01360f0 2024-09-18T12:57:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba7d51640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcba00a6010 con 0x7fcba0138fd0 2024-09-18T12:57:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7ff62caed640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff62809db00 0x7ff62809df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34392/0 (socket says 172.21.15.120:34392) 2024-09-18T12:57:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7ff62caed640 1 -- 172.21.15.120:0/1393106046 learned_addr learned my addr 172.21.15.120:0/1393106046 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba5aed640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcba01360f0 0x7fcba0136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34404/0 (socket says 172.21.15.120:34404) 2024-09-18T12:57:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba5aed640 1 -- 172.21.15.120:0/2678987388 learned_addr learned my addr 172.21.15.120:0/2678987388 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7ff627fff640 1 --2- 172.21.15.120:0/1393106046 >> v2:172.21.15.120:3300/0 conn(0x7ff62809e620 0x7ff628139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba52ec640 1 --2- 172.21.15.120:0/2678987388 >> v2:172.21.15.120:3300/0 conn(0x7fcba0138fd0 0x7fcba013b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7ff627fff640 1 -- 172.21.15.120:0/1393106046 >> v1:172.21.15.120:6789/0 conn(0x7ff62809db00 legacy=0x7ff62809df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7ff627fff640 1 -- 172.21.15.120:0/1393106046 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6280a0700 con 0x7ff62809e620 2024-09-18T12:57:46.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba4aeb640 1 -- 172.21.15.120:0/2678987388 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511947030 0 0) 0x7fcb9c001110 con 0x7fcba01360f0 2024-09-18T12:57:46.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba52ec640 1 -- 172.21.15.120:0/2678987388 >> v1:172.21.15.120:6789/0 conn(0x7fcba01360f0 legacy=0x7fcba0136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7ff627fff640 1 --2- 172.21.15.120:0/1393106046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809e620 0x7ff628139490 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc43e6d0aac18050 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.354+0000 7fcba52ec640 1 -- 172.21.15.120:0/2678987388 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba00a5c40 con 0x7fcba0138fd0 2024-09-18T12:57:46.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.355+0000 7ff6277fe640 1 -- 172.21.15.120:0/1393106046 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff614009d80 con 0x7ff62809e620 2024-09-18T12:57:46.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.355+0000 7fcba52ec640 1 --2- 172.21.15.120:0/2678987388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba0138fd0 0x7fcba013b3f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8907ca1c98af59d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.355+0000 7ff6277fe640 1 -- 172.21.15.120:0/1393106046 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff61400e230 con 0x7ff62809e620 2024-09-18T12:57:46.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.355+0000 7ff6277fe640 1 -- 172.21.15.120:0/1393106046 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff61400e4d0 con 0x7ff62809e620 2024-09-18T12:57:46.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.355+0000 7fcba4aeb640 1 -- 172.21.15.120:0/2678987388 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb90009d90 con 0x7fcba0138fd0 2024-09-18T12:57:46.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.355+0000 7fcba4aeb640 1 -- 172.21.15.120:0/2678987388 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcb9000e230 con 0x7fcba0138fd0 2024-09-18T12:57:46.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.355+0000 7fcba4aeb640 1 -- 172.21.15.120:0/2678987388 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb9000e4d0 con 0x7fcba0138fd0 2024-09-18T12:57:46.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 1 -- 172.21.15.120:0/1393106046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809e620 msgr2=0x7ff628139490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 1 --2- 172.21.15.120:0/1393106046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809e620 0x7ff628139490 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 1 -- 172.21.15.120:0/1393106046 shutdown_connections 2024-09-18T12:57:46.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 1 --2- 172.21.15.120:0/1393106046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809e620 0x7ff628139490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 1 -- 172.21.15.120:0/1393106046 >> 172.21.15.120:0/1393106046 conn(0x7ff6280a45b0 msgr2=0x7ff6280a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 1 -- 172.21.15.120:0/2678987388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba0138fd0 msgr2=0x7fcba013b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 1 --2- 172.21.15.120:0/2678987388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba0138fd0 0x7fcba013b3f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 1 -- 172.21.15.120:0/1393106046 shutdown_connections 2024-09-18T12:57:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 1 -- 172.21.15.120:0/1393106046 wait complete. 2024-09-18T12:57:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 1 -- 172.21.15.120:0/2678987388 shutdown_connections 2024-09-18T12:57:46.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 1 --2- 172.21.15.120:0/2678987388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba0138fd0 0x7fcba013b3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 1 -- 172.21.15.120:0/2678987388 >> 172.21.15.120:0/2678987388 conn(0x7fcba006f850 msgr2=0x7fcba009ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 1 -- 172.21.15.120:0/2678987388 shutdown_connections 2024-09-18T12:57:46.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 1 -- 172.21.15.120:0/2678987388 wait complete. 2024-09-18T12:57:46.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7ff62ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.356+0000 7fcba7d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.346+0000 7f3bb0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.346+0000 7f0e36f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.358+0000 7ff62ed51640 1 Processor -- start 2024-09-18T12:57:46.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.358+0000 7fcba7d51640 1 Processor -- start 2024-09-18T12:57:46.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.358+0000 7fcba7d51640 1 -- start start 2024-09-18T12:57:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.358+0000 7ff62ed51640 1 -- start start 2024-09-18T12:57:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.358+0000 7f3bb0d51640 1 Processor -- start 2024-09-18T12:57:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.358+0000 7f3bb0d51640 1 -- start start 2024-09-18T12:57:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7f0e36f91640 1 Processor -- start 2024-09-18T12:57:46.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7f0e36f91640 1 -- start start 2024-09-18T12:57:46.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7fcba7d51640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba01360f0 0x7fcba0134800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7fcba7d51640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcba0121bc0 con 0x7fcba01360f0 2024-09-18T12:57:46.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7fcba5aed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba01360f0 0x7fcba0134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7ff62ed51640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809db00 0x7ff6281c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7ff62ed51640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff62812c760 con 0x7ff62809db00 2024-09-18T12:57:46.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7fcba5aed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba01360f0 0x7fcba0134800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55186/0 (socket says 172.21.15.120:55186) 2024-09-18T12:57:46.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7fcba5aed640 1 -- 172.21.15.120:0/283662535 learned_addr learned my addr 172.21.15.120:0/283662535 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7ff62caed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809db00 0x7ff6281c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7ff62caed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809db00 0x7ff6281c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55192/0 (socket says 172.21.15.120:55192) 2024-09-18T12:57:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7ff62caed640 1 -- 172.21.15.120:0/3345998084 learned_addr learned my addr 172.21.15.120:0/3345998084 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.359+0000 7f3bb0d51640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3bac09d570 0x7f3bac13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3bb0d51640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bac0a0060 con 0x7f3bac09ca50 2024-09-18T12:57:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3bb0d51640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f3bac09fd30 con 0x7f3bac09d570 2024-09-18T12:57:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3ba9d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3bac09d570 0x7f3bac13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7fcba5aed640 1 -- 172.21.15.120:0/283662535 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba0134e90 con 0x7fcba01360f0 2024-09-18T12:57:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3baa59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3bac09ca50 0x7f3bac09ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34406/0 (socket says 172.21.15.120:34406) 2024-09-18T12:57:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3baa59c640 1 -- 172.21.15.120:0/3968541191 learned_addr learned my addr 172.21.15.120:0/3968541191 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:46.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7ff62caed640 1 -- 172.21.15.120:0/3345998084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62812d380 con 0x7ff62809db00 2024-09-18T12:57:46.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f0e36f91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e3009e620 0x7f0e30139490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7ff62caed640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809db00 0x7ff6281c8af0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f0e36f91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3009ed40 con 0x7f0e3009db00 2024-09-18T12:57:46.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7fcba5aed640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba01360f0 0x7fcba0134800 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f0e36f91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3009ea30 con 0x7f0e3009e620 2024-09-18T12:57:46.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f0e2ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e3009e620 0x7f0e30139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3ba959a640 1 -- 172.21.15.120:0/3968541191 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105175799 0 0) 0x7f3bac0a0060 con 0x7f3bac09ca50 2024-09-18T12:57:46.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3ba959a640 1 -- 172.21.15.120:0/3968541191 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b94003580 con 0x7f3bac09ca50 2024-09-18T12:57:46.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f0e2ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e3009e620 0x7f0e30139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55216/0 (socket says 172.21.15.120:55216) 2024-09-18T12:57:46.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f0e2ffff640 1 -- 172.21.15.120:0/569514042 learned_addr learned my addr 172.21.15.120:0/569514042 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3ba9d9b640 1 -- 172.21.15.120:0/3968541191 >> v1:172.21.15.120:6789/0 conn(0x7f3bac09ca50 legacy=0x7f3bac09ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3ba9d9b640 1 -- 172.21.15.120:0/3968541191 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac09e3c0 con 0x7f3bac09d570 2024-09-18T12:57:46.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7ff6257fa640 1 -- 172.21.15.120:0/3345998084 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff61c005a60 con 0x7ff62809db00 2024-09-18T12:57:46.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7ff6257fa640 1 -- 172.21.15.120:0/3345998084 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff61c005bc0 con 0x7ff62809db00 2024-09-18T12:57:46.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7ff6257fa640 1 -- 172.21.15.120:0/3345998084 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff61c005e60 con 0x7ff62809db00 2024-09-18T12:57:46.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7fcb967fc640 1 -- 172.21.15.120:0/283662535 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb9c004b80 con 0x7fcba01360f0 2024-09-18T12:57:46.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62812e920 con 0x7ff62809db00 2024-09-18T12:57:46.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.360+0000 7f3ba9d9b640 1 --2- 172.21.15.120:0/3968541191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09d570 0x7f3bac13b3b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e323135c9de0c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7fcb967fc640 1 -- 172.21.15.120:0/283662535 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcb9c004ce0 con 0x7fcba01360f0 2024-09-18T12:57:46.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7fcb967fc640 1 -- 172.21.15.120:0/283662535 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb9c007120 con 0x7fcba01360f0 2024-09-18T12:57:46.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba01247e0 con 0x7fcba01360f0 2024-09-18T12:57:46.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62812e530 con 0x7ff62809db00 2024-09-18T12:57:46.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba0123c90 con 0x7fcba01360f0 2024-09-18T12:57:46.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7f0e2ffff640 1 -- 172.21.15.120:0/569514042 >> v1:172.21.15.120:6789/0 conn(0x7f0e3009db00 legacy=0x7f0e3009df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7f0e2ffff640 1 -- 172.21.15.120:0/569514042 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e300a0700 con 0x7f0e3009e620 2024-09-18T12:57:46.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7f0e2ffff640 1 --2- 172.21.15.120:0/569514042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009e620 0x7f0e30139490 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90997d5557835b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.361+0000 7f3ba959a640 1 -- 172.21.15.120:0/3968541191 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ba0009d80 con 0x7f3bac09d570 2024-09-18T12:57:46.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7f3ba959a640 1 -- 172.21.15.120:0/3968541191 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3ba000e230 con 0x7f3bac09d570 2024-09-18T12:57:46.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7f3ba959a640 1 -- 172.21.15.120:0/3968541191 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ba000e4d0 con 0x7f3bac09d570 2024-09-18T12:57:46.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7f0e2f7fe640 1 -- 172.21.15.120:0/569514042 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e24009e40 con 0x7f0e3009e620 2024-09-18T12:57:46.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7f0e2f7fe640 1 -- 172.21.15.120:0/569514042 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0e2400e230 con 0x7f0e3009e620 2024-09-18T12:57:46.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7f0e2f7fe640 1 -- 172.21.15.120:0/569514042 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e2400e4d0 con 0x7f0e3009e620 2024-09-18T12:57:46.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba00a10f0 con 0x7fcba01360f0 2024-09-18T12:57:46.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff62809df10 con 0x7ff62809db00 2024-09-18T12:57:46.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7fcb967fc640 1 -- 172.21.15.120:0/283662535 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcb9c0072d0 con 0x7fcba01360f0 2024-09-18T12:57:46.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7ff6257fa640 1 -- 172.21.15.120:0/3345998084 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff61c00c7f0 con 0x7ff62809db00 2024-09-18T12:57:46.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 1 -- 172.21.15.120:0/3968541191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09d570 msgr2=0x7f3bac13b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7ff6257fa640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ff60c03e980 0x7ff60c040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.362+0000 7fcb967fc640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcb8403e930 0x7fcb84040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7fcb967fc640 1 -- 172.21.15.120:0/283662535 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7fcb9c04f680 con 0x7fcba01360f0 2024-09-18T12:57:46.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 1 --2- 172.21.15.120:0/3968541191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09d570 0x7f3bac13b3b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7ff6257fa640 1 -- 172.21.15.120:0/3345998084 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7ff61c04f6c0 con 0x7ff62809db00 2024-09-18T12:57:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7fcba52ec640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcb8403e930 0x7fcb84040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 1 -- 172.21.15.120:0/3968541191 shutdown_connections 2024-09-18T12:57:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 1 --2- 172.21.15.120:0/3968541191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09d570 0x7f3bac13b3b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 1 -- 172.21.15.120:0/3968541191 >> 172.21.15.120:0/3968541191 conn(0x7f3bac0a5230 msgr2=0x7f3bac0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7ff627fff640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ff60c03e980 0x7ff60c040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 1 -- 172.21.15.120:0/3968541191 shutdown_connections 2024-09-18T12:57:46.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f0e36f91640 1 -- 172.21.15.120:0/569514042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009e620 msgr2=0x7f0e30139490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 1 -- 172.21.15.120:0/3968541191 wait complete. 2024-09-18T12:57:46.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f0e36f91640 1 --2- 172.21.15.120:0/569514042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009e620 0x7f0e30139490 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f0e36f91640 1 -- 172.21.15.120:0/569514042 shutdown_connections 2024-09-18T12:57:46.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f0e36f91640 1 --2- 172.21.15.120:0/569514042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009e620 0x7f0e30139490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f0e36f91640 1 -- 172.21.15.120:0/569514042 >> 172.21.15.120:0/569514042 conn(0x7f0e300a45b0 msgr2=0x7f0e300a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7fcba52ec640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcb8403e930 0x7fcb84040e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f0e36f91640 1 -- 172.21.15.120:0/569514042 shutdown_connections 2024-09-18T12:57:46.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f3bb0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.363+0000 7f0e36f91640 1 -- 172.21.15.120:0/569514042 wait complete. 2024-09-18T12:57:46.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.364+0000 7ff627fff640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ff60c03e980 0x7ff60c040e90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.364+0000 7f0e36f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.365+0000 7f3bb0d51640 1 Processor -- start 2024-09-18T12:57:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.365+0000 7f3bb0d51640 1 -- start start 2024-09-18T12:57:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f3bb0d51640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09ca50 0x7f3bac124df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f3bb0d51640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3bac1362c0 con 0x7f3bac09ca50 2024-09-18T12:57:46.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f3baa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09ca50 0x7f3bac124df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f3baa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09ca50 0x7f3bac124df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55232/0 (socket says 172.21.15.120:55232) 2024-09-18T12:57:46.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f0e36f91640 1 Processor -- start 2024-09-18T12:57:46.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f3baa59c640 1 -- 172.21.15.120:0/4156961548 learned_addr learned my addr 172.21.15.120:0/4156961548 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f0e36f91640 1 -- start start 2024-09-18T12:57:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.366+0000 7f3baa59c640 1 -- 172.21.15.120:0/4156961548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac1236b0 con 0x7f3bac09ca50 2024-09-18T12:57:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.367+0000 7f3baa59c640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09ca50 0x7f3bac124df0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.368+0000 7f0e36f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009db00 0x7f0e301b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.369+0000 7f0e36f91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0e301b49b0 con 0x7f0e3009db00 2024-09-18T12:57:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.369+0000 7f0e34d2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009db00 0x7f0e301b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.369+0000 7f0e34d2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009db00 0x7f0e301b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55242/0 (socket says 172.21.15.120:55242) 2024-09-18T12:57:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.369+0000 7f0e34d2d640 1 -- 172.21.15.120:0/783910537 learned_addr learned my addr 172.21.15.120:0/783910537 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.369+0000 7f0e34d2d640 1 -- 172.21.15.120:0/783910537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e301b4100 con 0x7f0e3009db00 2024-09-18T12:57:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.369+0000 7f0e34d2d640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009db00 0x7f0e301b60f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.371+0000 7fcb967fc640 1 -- 172.21.15.120:0/283662535 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fcb9c00a890 con 0x7fcba01360f0 2024-09-18T12:57:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f3b9affd640 1 -- 172.21.15.120:0/4156961548 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b9c005a60 con 0x7f3bac09ca50 2024-09-18T12:57:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bac123060 con 0x7f3bac09ca50 2024-09-18T12:57:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bac1244d0 con 0x7f3bac09ca50 2024-09-18T12:57:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f3b9affd640 1 -- 172.21.15.120:0/4156961548 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b9c005bc0 con 0x7f3bac09ca50 2024-09-18T12:57:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7ff6257fa640 1 -- 172.21.15.120:0/3345998084 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7ff61c00dc10 con 0x7ff62809db00 2024-09-18T12:57:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f0e2d7fa640 1 -- 172.21.15.120:0/783910537 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e2000c850 con 0x7f0e3009db00 2024-09-18T12:57:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f0e2d7fa640 1 -- 172.21.15.120:0/783910537 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0e2000c9b0 con 0x7f0e3009db00 2024-09-18T12:57:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e301b5260 con 0x7f0e3009db00 2024-09-18T12:57:46.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f0e2d7fa640 1 -- 172.21.15.120:0/783910537 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e2000cc50 con 0x7f0e3009db00 2024-09-18T12:57:46.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.376+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e301b5970 con 0x7f0e3009db00 2024-09-18T12:57:46.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.377+0000 7f3b9affd640 1 -- 172.21.15.120:0/4156961548 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b9c005e60 con 0x7f3bac09ca50 2024-09-18T12:57:46.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.377+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b900050f0 con 0x7f3bac09ca50 2024-09-18T12:57:46.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.378+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e300a2b20 con 0x7f0e3009db00 2024-09-18T12:57:46.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.378+0000 7f3b9affd640 1 -- 172.21.15.120:0/4156961548 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3b9c0070b0 con 0x7f3bac09ca50 2024-09-18T12:57:46.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.378+0000 7f0e2d7fa640 1 -- 172.21.15.120:0/783910537 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0e20012380 con 0x7f0e3009db00 2024-09-18T12:57:46.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.378+0000 7f3b9affd640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3b8c03e930 0x7f3b8c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.378+0000 7f3b9affd640 1 -- 172.21.15.120:0/4156961548 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f3b9c04f670 con 0x7f3bac09ca50 2024-09-18T12:57:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.379+0000 7f0e2d7fa640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0e1c03e930 0x7f0e1c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.379+0000 7f0e2d7fa640 1 -- 172.21.15.120:0/783910537 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f0e20050000 con 0x7f0e3009db00 2024-09-18T12:57:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.379+0000 7f3ba9d9b640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3b8c03e930 0x7f3b8c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.379+0000 7f0e2ffff640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0e1c03e930 0x7f0e1c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.379+0000 7f3ba9d9b640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3b8c03e930 0x7f3b8c040e40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.379+0000 7f0e2ffff640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0e1c03e930 0x7f0e1c040e40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.383+0000 7f0e2d7fa640 1 -- 172.21.15.120:0/783910537 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f0e2000a720 con 0x7f0e3009db00 2024-09-18T12:57:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.388+0000 7f3b9affd640 1 -- 172.21.15.120:0/4156961548 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f3b9c00dc60 con 0x7f3bac09ca50 2024-09-18T12:57:46.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.560+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff628078480 con 0x7ff62809db00 2024-09-18T12:57:46.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.561+0000 7ff6257fa640 1 -- 172.21.15.120:0/3345998084 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7ff61c00d610 con 0x7ff62809db00 2024-09-18T12:57:46.562 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ff60c03e980 msgr2=0x7ff60c040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ff60c03e980 0x7ff60c040e90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809db00 msgr2=0x7ff6281c8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809db00 0x7ff6281c8af0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 shutdown_connections 2024-09-18T12:57:46.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ff60c03e980 0x7ff60c040e90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 --2- 172.21.15.120:0/3345998084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff62809db00 0x7ff6281c8af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 >> 172.21.15.120:0/3345998084 conn(0x7ff6280a45b0 msgr2=0x7ff6280a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 shutdown_connections 2024-09-18T12:57:46.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.564+0000 7ff62ed51640 1 -- 172.21.15.120:0/3345998084 wait complete. 2024-09-18T12:57:46.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.576+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3b900053a0 con 0x7f3bac09ca50 2024-09-18T12:57:46.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.577+0000 7f3b9affd640 1 -- 172.21.15.120:0/4156961548 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f3b9c00d660 con 0x7f3bac09ca50 2024-09-18T12:57:46.578 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3b8c03e930 msgr2=0x7f3b8c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3b8c03e930 0x7f3b8c040e40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09ca50 msgr2=0x7f3bac124df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-18T12:57:46.582 DEBUG:teuthology.parallel:result is None 2024-09-18T12:57:46.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09ca50 0x7f3bac124df0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 shutdown_connections 2024-09-18T12:57:46.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3b8c03e930 0x7f3b8c040e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 --2- 172.21.15.120:0/4156961548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac09ca50 0x7f3bac124df0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 >> 172.21.15.120:0/4156961548 conn(0x7f3bac0a5230 msgr2=0x7f3bac0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 shutdown_connections 2024-09-18T12:57:46.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.579+0000 7f3bb0d51640 1 -- 172.21.15.120:0/4156961548 wait complete. 2024-09-18T12:57:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.588+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcba009f5a0 con 0x7fcba01360f0 2024-09-18T12:57:46.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.589+0000 7fcb967fc640 1 -- 172.21.15.120:0/283662535 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fcb9c00a890 con 0x7fcba01360f0 2024-09-18T12:57:46.590 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2024-09-18T12:57:46.591 DEBUG:teuthology.parallel:result is None 2024-09-18T12:57:46.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcb8403e930 msgr2=0x7fcb84040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcb8403e930 0x7fcb84040e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba01360f0 msgr2=0x7fcba0134800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba01360f0 0x7fcba0134800 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 shutdown_connections 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcb8403e930 0x7fcb84040e40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 --2- 172.21.15.120:0/283662535 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcba01360f0 0x7fcba0134800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 >> 172.21.15.120:0/283662535 conn(0x7fcba006f850 msgr2=0x7fcba01be0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 shutdown_connections 2024-09-18T12:57:46.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.591+0000 7fcba7d51640 1 -- 172.21.15.120:0/283662535 wait complete. 2024-09-18T12:57:46.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.593+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0e3009df10 con 0x7f0e3009db00 2024-09-18T12:57:46.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.593+0000 7f0e2d7fa640 1 -- 172.21.15.120:0/783910537 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f0e2000a120 con 0x7f0e3009db00 2024-09-18T12:57:46.596 INFO:teuthology.orchestra.run.smithi120.stdout:38654705672 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.596+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0e1c03e930 msgr2=0x7f0e1c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.596+0000 7f0e36f91640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0e1c03e930 0x7f0e1c040e40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.596+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009db00 msgr2=0x7f0e301b60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.596+0000 7f0e36f91640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009db00 0x7f0e301b60f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.597+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 shutdown_connections 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.597+0000 7f0e36f91640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0e1c03e930 0x7f0e1c040e40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.597+0000 7f0e36f91640 1 --2- 172.21.15.120:0/783910537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e3009db00 0x7f0e301b60f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.597+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 >> 172.21.15.120:0/783910537 conn(0x7f0e300a45b0 msgr2=0x7f0e3009ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.597+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 shutdown_connections 2024-09-18T12:57:46.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.597+0000 7f0e36f91640 1 -- 172.21.15.120:0/783910537 wait complete. 2024-09-18T12:57:46.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-09-18T12:57:46.604 DEBUG:teuthology.parallel:result is None 2024-09-18T12:57:46.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-09-18T12:57:46.609 DEBUG:teuthology.parallel:result is None 2024-09-18T12:57:46.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T12:57:46.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:57:46.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.753+0000 7fdd8ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.757+0000 7fdd8ff91640 1 Processor -- start 2024-09-18T12:57:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.758+0000 7fdd8ff91640 1 -- start start 2024-09-18T12:57:46.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8ff91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd88133c50 0x7fdd88134060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8ff91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd880a2590 con 0x7fdd881345a0 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8ff91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fdd880a2c00 con 0x7fdd88133c50 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8dd2d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd88133c50 0x7fdd88134060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8d52c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdd881345a0 0x7fdd88132b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34418/0 (socket says 172.21.15.120:34418) 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8d52c640 1 -- 172.21.15.120:0/1733364177 learned_addr learned my addr 172.21.15.120:0/1733364177 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8dd2d640 1 -- 172.21.15.120:0/1733364177 >> v1:172.21.15.120:6789/0 conn(0x7fdd881345a0 legacy=0x7fdd88132b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8cd2b640 1 -- 172.21.15.120:0/1733364177 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624584415 0 0) 0x7fdd880a2590 con 0x7fdd881345a0 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8dd2d640 1 -- 172.21.15.120:0/1733364177 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8809dfb0 con 0x7fdd88133c50 2024-09-18T12:57:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8dd2d640 1 --2- 172.21.15.120:0/1733364177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88134060 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d90db9d2c438132 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8cd2b640 1 -- 172.21.15.120:0/1733364177 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd7800e040 con 0x7fdd88133c50 2024-09-18T12:57:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8cd2b640 1 -- 172.21.15.120:0/1733364177 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd78007670 con 0x7fdd88133c50 2024-09-18T12:57:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.759+0000 7fdd8cd2b640 1 -- 172.21.15.120:0/1733364177 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd78007910 con 0x7fdd88133c50 2024-09-18T12:57:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.760+0000 7fdd8ff91640 1 -- 172.21.15.120:0/1733364177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 msgr2=0x7fdd88134060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.760+0000 7fdd8ff91640 1 --2- 172.21.15.120:0/1733364177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88134060 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.760+0000 7fdd8ff91640 1 -- 172.21.15.120:0/1733364177 shutdown_connections 2024-09-18T12:57:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.760+0000 7fdd8ff91640 1 --2- 172.21.15.120:0/1733364177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88134060 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.760+0000 7fdd8ff91640 1 -- 172.21.15.120:0/1733364177 >> 172.21.15.120:0/1733364177 conn(0x7fdd880a3050 msgr2=0x7fdd880a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.760+0000 7fdd8ff91640 1 -- 172.21.15.120:0/1733364177 shutdown_connections 2024-09-18T12:57:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.760+0000 7fdd8ff91640 1 -- 172.21.15.120:0/1733364177 wait complete. 2024-09-18T12:57:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.761+0000 7fdd8ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:46.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.762+0000 7fdd8ff91640 1 Processor -- start 2024-09-18T12:57:46.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.762+0000 7fdd8ff91640 1 -- start start 2024-09-18T12:57:46.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd8ff91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd8ff91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdd88133a80 con 0x7fdd88133c50 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd8dd2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd8dd2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88120770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55256/0 (socket says 172.21.15.120:55256) 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd8dd2d640 1 -- 172.21.15.120:0/460856816 learned_addr learned my addr 172.21.15.120:0/460856816 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd8dd2d640 1 -- 172.21.15.120:0/460856816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd881221b0 con 0x7fdd88133c50 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd8dd2d640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88120770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd867fc640 1 -- 172.21.15.120:0/460856816 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd7800e040 con 0x7fdd88133c50 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.763+0000 7fdd867fc640 1 -- 172.21.15.120:0/460856816 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd78012a40 con 0x7fdd88133c50 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.764+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd88121900 con 0x7fdd88133c50 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.764+0000 7fdd867fc640 1 -- 172.21.15.120:0/460856816 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd78012ce0 con 0x7fdd88133c50 2024-09-18T12:57:46.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.764+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd88122fd0 con 0x7fdd88133c50 2024-09-18T12:57:46.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.765+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8809d8b0 con 0x7fdd88133c50 2024-09-18T12:57:46.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.765+0000 7fdd867fc640 1 -- 172.21.15.120:0/460856816 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fdd780153f0 con 0x7fdd88133c50 2024-09-18T12:57:46.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.765+0000 7fdd867fc640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdd7403e930 0x7fdd74040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:46.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.765+0000 7fdd867fc640 1 -- 172.21.15.120:0/460856816 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7fdd78051090 con 0x7fdd88133c50 2024-09-18T12:57:46.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.765+0000 7fdd8d52c640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdd7403e930 0x7fdd74040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:46.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.766+0000 7fdd8d52c640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdd7403e930 0x7fdd74040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:46.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.770+0000 7fdd867fc640 1 -- 172.21.15.120:0/460856816 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fdd7800e1a0 con 0x7fdd88133c50 2024-09-18T12:57:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.943+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd88076fc0 con 0x7fdd7403e930 2024-09-18T12:57:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.944+0000 7fdd867fc640 1 -- 172.21.15.120:0/460856816 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+30911 (crc 0 0 0) 0x7fdd88076fc0 con 0x7fdd7403e930 2024-09-18T12:57:46.946 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:46.946 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T12:57:46.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdd7403e930 msgr2=0x7fdd74040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdd7403e930 0x7fdd74040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 msgr2=0x7fdd88120770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:46.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88120770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 shutdown_connections 2024-09-18T12:57:46.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdd7403e930 0x7fdd74040e40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 --2- 172.21.15.120:0/460856816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd88133c50 0x7fdd88120770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:46.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 >> 172.21.15.120:0/460856816 conn(0x7fdd880a3050 msgr2=0x7fdd88072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:46.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 shutdown_connections 2024-09-18T12:57:46.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:46.947+0000 7fdd8ff91640 1 -- 172.21.15.120:0/460856816 wait complete. 2024-09-18T12:57:46.959 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-18T12:57:46.577736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":671744,"data_stored":1325830,"data_compressed":60070,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.422115"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.676488+0000","last_change":"2024-09-18T12:57:44.682637+0000","last_active":"2024-09-18T12:57:44.676488+0000","last_peered":"2024-09-18T12:57:44.676488+0000","last_clean":"2024-09-18T12:57:44.676488+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T12:57:44.676488+0000","last_undegraded":"2024-09-18T12:57:44.676488+0000","last_fullsized":"2024-09-18T12:57:44.676488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.680830+0000","last_change":"2024-09-18T12:57:44.684106+0000","last_active":"2024-09-18T12:57:44.680830+0000","last_peered":"2024-09-18T12:57:44.680830+0000","last_clean":"2024-09-18T12:57:44.680830+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T12:57:44.680830+0000","last_undegraded":"2024-09-18T12:57:44.680830+0000","last_fullsized":"2024-09-18T12:57:44.680830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.678047+0000","last_change":"2024-09-18T12:57:44.680252+0000","last_active":"2024-09-18T12:57:44.678047+0000","last_peered":"2024-09-18T12:57:44.678047+0000","last_clean":"2024-09-18T12:57:44.678047+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T12:57:44.678047+0000","last_undegraded":"2024-09-18T12:57:44.678047+0000","last_fullsized":"2024-09-18T12:57:44.678047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.681694+0000","last_change":"2024-09-18T12:57:44.684632+0000","last_active":"2024-09-18T12:57:44.681694+0000","last_peered":"2024-09-18T12:57:44.681694+0000","last_clean":"2024-09-18T12:57:44.681694+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T12:57:44.681694+0000","last_undegraded":"2024-09-18T12:57:44.681694+0000","last_fullsized":"2024-09-18T12:57:44.681694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.684900+0000","last_change":"2024-09-18T12:57:44.684900+0000","last_active":"2024-09-18T12:57:44.684900+0000","last_peered":"2024-09-18T12:57:44.684900+0000","last_clean":"2024-09-18T12:57:44.684900+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T12:57:44.684900+0000","last_undegraded":"2024-09-18T12:57:44.684900+0000","last_fullsized":"2024-09-18T12:57:44.684900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.681054+0000","last_change":"2024-09-18T12:57:44.684570+0000","last_active":"2024-09-18T12:57:44.681054+0000","last_peered":"2024-09-18T12:57:44.681054+0000","last_clean":"2024-09-18T12:57:44.681054+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T12:57:44.681054+0000","last_undegraded":"2024-09-18T12:57:44.681054+0000","last_fullsized":"2024-09-18T12:57:44.681054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.679219+0000","last_change":"2024-09-18T12:57:44.682925+0000","last_active":"2024-09-18T12:57:44.679219+0000","last_peered":"2024-09-18T12:57:44.679219+0000","last_clean":"2024-09-18T12:57:44.679219+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T12:57:44.679219+0000","last_undegraded":"2024-09-18T12:57:44.679219+0000","last_fullsized":"2024-09-18T12:57:44.679219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.682617+0000","last_change":"2024-09-18T12:57:44.685288+0000","last_active":"2024-09-18T12:57:44.682617+0000","last_peered":"2024-09-18T12:57:44.682617+0000","last_clean":"2024-09-18T12:57:44.682617+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T12:57:44.682617+0000","last_undegraded":"2024-09-18T12:57:44.682617+0000","last_fullsized":"2024-09-18T12:57:44.682617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":90,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.676078+0000","last_change":"2024-09-18T12:57:39.686575+0000","last_active":"2024-09-18T12:57:44.676078+0000","last_peered":"2024-09-18T12:57:44.676078+0000","last_clean":"2024-09-18T12:57:44.676078+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T12:57:44.676078+0000","last_undegraded":"2024-09-18T12:57:44.676078+0000","last_fullsized":"2024-09-18T12:57:44.676078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26968,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344872,"statfs":{"total":96636764160,"available":96609148928,"internally_reserved":0,"allocated":139264,"data_stored":36283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":196608,"data_stored":626632,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626651,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26964,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344876,"statfs":{"total":96636764160,"available":96609153024,"internally_reserved":0,"allocated":135168,"data_stored":36264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:57:46.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:57:47.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.063+0000 7fb257f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:47.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.067+0000 7fb257f91640 1 Processor -- start 2024-09-18T12:57:47.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.068+0000 7fb257f91640 1 -- start start 2024-09-18T12:57:47.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb257f91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb250133c50 0x7fb250134060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:47.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb257f91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2500a2590 con 0x7fb2501345a0 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb257f91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb2500a2c00 con 0x7fb250133c50 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb255d2d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb250133c50 0x7fb250134060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb25552c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb2501345a0 0x7fb250132b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34422/0 (socket says 172.21.15.120:34422) 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb25552c640 1 -- 172.21.15.120:0/1449260245 learned_addr learned my addr 172.21.15.120:0/1449260245 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb255d2d640 1 --2- 172.21.15.120:0/1449260245 >> v2:172.21.15.120:3300/0 conn(0x7fb250133c50 0x7fb250134060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55262/0 (socket says 172.21.15.120:55262) 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb255d2d640 1 -- 172.21.15.120:0/1449260245 >> v1:172.21.15.120:6789/0 conn(0x7fb2501345a0 legacy=0x7fb250132b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb255d2d640 1 -- 172.21.15.120:0/1449260245 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25009dfb0 con 0x7fb250133c50 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb254d2b640 1 -- 172.21.15.120:0/1449260245 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541997217 0 0) 0x7fb2500a2590 con 0x7fb2501345a0 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb255d2d640 1 --2- 172.21.15.120:0/1449260245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250134060 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411fd9661f7552e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.069+0000 7fb254d2b640 1 -- 172.21.15.120:0/1449260245 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb24000e040 con 0x7fb250133c50 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb254d2b640 1 -- 172.21.15.120:0/1449260245 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb240007670 con 0x7fb250133c50 2024-09-18T12:57:47.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb254d2b640 1 -- 172.21.15.120:0/1449260245 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb240007910 con 0x7fb250133c50 2024-09-18T12:57:47.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb257f91640 1 -- 172.21.15.120:0/1449260245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 msgr2=0x7fb250134060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb257f91640 1 --2- 172.21.15.120:0/1449260245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250134060 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb257f91640 1 -- 172.21.15.120:0/1449260245 shutdown_connections 2024-09-18T12:57:47.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb257f91640 1 --2- 172.21.15.120:0/1449260245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250134060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb257f91640 1 -- 172.21.15.120:0/1449260245 >> 172.21.15.120:0/1449260245 conn(0x7fb2500a3050 msgr2=0x7fb2500a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:47.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb257f91640 1 -- 172.21.15.120:0/1449260245 shutdown_connections 2024-09-18T12:57:47.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.070+0000 7fb257f91640 1 -- 172.21.15.120:0/1449260245 wait complete. 2024-09-18T12:57:47.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.071+0000 7fb257f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:47.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.072+0000 7fb257f91640 1 Processor -- start 2024-09-18T12:57:47.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.072+0000 7fb257f91640 1 -- start start 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.073+0000 7fb257f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.073+0000 7fb257f91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501245b0 con 0x7fb250133c50 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.073+0000 7fb255d2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.073+0000 7fb255d2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250120f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55272/0 (socket says 172.21.15.120:55272) 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.073+0000 7fb255d2d640 1 -- 172.21.15.120:0/1694801157 learned_addr learned my addr 172.21.15.120:0/1694801157 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.073+0000 7fb255d2d640 1 -- 172.21.15.120:0/1694801157 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb250120b60 con 0x7fb250133c50 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.073+0000 7fb255d2d640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250120f20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.074+0000 7fb24e7fc640 1 -- 172.21.15.120:0/1694801157 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb24000e040 con 0x7fb250133c50 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.074+0000 7fb24e7fc640 1 -- 172.21.15.120:0/1694801157 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb2400139f0 con 0x7fb250133c50 2024-09-18T12:57:47.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.074+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb250122130 con 0x7fb250133c50 2024-09-18T12:57:47.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.074+0000 7fb24e7fc640 1 -- 172.21.15.120:0/1694801157 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb240013c90 con 0x7fb250133c50 2024-09-18T12:57:47.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.074+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb250123a60 con 0x7fb250133c50 2024-09-18T12:57:47.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.075+0000 7fb24e7fc640 1 -- 172.21.15.120:0/1694801157 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb240011040 con 0x7fb250133c50 2024-09-18T12:57:47.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.075+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb250122930 con 0x7fb250133c50 2024-09-18T12:57:47.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.075+0000 7fb24e7fc640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb23c03e930 0x7fb23c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:47.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.075+0000 7fb24e7fc640 1 -- 172.21.15.120:0/1694801157 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7fb240050ff0 con 0x7fb250133c50 2024-09-18T12:57:47.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.075+0000 7fb25552c640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb23c03e930 0x7fb23c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:47.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.076+0000 7fb25552c640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb23c03e930 0x7fb23c040e40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:47.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.080+0000 7fb24e7fc640 1 -- 172.21.15.120:0/1694801157 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fb240015390 con 0x7fb250133c50 2024-09-18T12:57:47.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.254+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb250120960 con 0x7fb23c03e930 2024-09-18T12:57:47.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.255+0000 7fb24e7fc640 1 -- 172.21.15.120:0/1694801157 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+30911 (crc 0 0 0) 0x7fb250120960 con 0x7fb23c03e930 2024-09-18T12:57:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:47.257 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T12:57:47.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb23c03e930 msgr2=0x7fb23c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb23c03e930 0x7fb23c040e40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 msgr2=0x7fb250120f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250120f20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 shutdown_connections 2024-09-18T12:57:47.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb23c03e930 0x7fb23c040e40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 --2- 172.21.15.120:0/1694801157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb250133c50 0x7fb250120f20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 >> 172.21.15.120:0/1694801157 conn(0x7fb2500a3050 msgr2=0x7fb250072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:47.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 shutdown_connections 2024-09-18T12:57:47.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.258+0000 7fb257f91640 1 -- 172.21.15.120:0/1694801157 wait complete. 2024-09-18T12:57:47.270 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-18T12:57:46.577736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":671744,"data_stored":1325830,"data_compressed":60070,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.422115"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.676488+0000","last_change":"2024-09-18T12:57:44.682637+0000","last_active":"2024-09-18T12:57:44.676488+0000","last_peered":"2024-09-18T12:57:44.676488+0000","last_clean":"2024-09-18T12:57:44.676488+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T12:57:44.676488+0000","last_undegraded":"2024-09-18T12:57:44.676488+0000","last_fullsized":"2024-09-18T12:57:44.676488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.680830+0000","last_change":"2024-09-18T12:57:44.684106+0000","last_active":"2024-09-18T12:57:44.680830+0000","last_peered":"2024-09-18T12:57:44.680830+0000","last_clean":"2024-09-18T12:57:44.680830+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T12:57:44.680830+0000","last_undegraded":"2024-09-18T12:57:44.680830+0000","last_fullsized":"2024-09-18T12:57:44.680830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.678047+0000","last_change":"2024-09-18T12:57:44.680252+0000","last_active":"2024-09-18T12:57:44.678047+0000","last_peered":"2024-09-18T12:57:44.678047+0000","last_clean":"2024-09-18T12:57:44.678047+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T12:57:44.678047+0000","last_undegraded":"2024-09-18T12:57:44.678047+0000","last_fullsized":"2024-09-18T12:57:44.678047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.681694+0000","last_change":"2024-09-18T12:57:44.684632+0000","last_active":"2024-09-18T12:57:44.681694+0000","last_peered":"2024-09-18T12:57:44.681694+0000","last_clean":"2024-09-18T12:57:44.681694+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T12:57:44.681694+0000","last_undegraded":"2024-09-18T12:57:44.681694+0000","last_fullsized":"2024-09-18T12:57:44.681694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.684900+0000","last_change":"2024-09-18T12:57:44.684900+0000","last_active":"2024-09-18T12:57:44.684900+0000","last_peered":"2024-09-18T12:57:44.684900+0000","last_clean":"2024-09-18T12:57:44.684900+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T12:57:44.684900+0000","last_undegraded":"2024-09-18T12:57:44.684900+0000","last_fullsized":"2024-09-18T12:57:44.684900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.681054+0000","last_change":"2024-09-18T12:57:44.684570+0000","last_active":"2024-09-18T12:57:44.681054+0000","last_peered":"2024-09-18T12:57:44.681054+0000","last_clean":"2024-09-18T12:57:44.681054+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T12:57:44.681054+0000","last_undegraded":"2024-09-18T12:57:44.681054+0000","last_fullsized":"2024-09-18T12:57:44.681054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.679219+0000","last_change":"2024-09-18T12:57:44.682925+0000","last_active":"2024-09-18T12:57:44.679219+0000","last_peered":"2024-09-18T12:57:44.679219+0000","last_clean":"2024-09-18T12:57:44.679219+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T12:57:44.679219+0000","last_undegraded":"2024-09-18T12:57:44.679219+0000","last_fullsized":"2024-09-18T12:57:44.679219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.682617+0000","last_change":"2024-09-18T12:57:44.685288+0000","last_active":"2024-09-18T12:57:44.682617+0000","last_peered":"2024-09-18T12:57:44.682617+0000","last_clean":"2024-09-18T12:57:44.682617+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T12:57:44.682617+0000","last_undegraded":"2024-09-18T12:57:44.682617+0000","last_fullsized":"2024-09-18T12:57:44.682617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":90,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T12:57:44.676078+0000","last_change":"2024-09-18T12:57:39.686575+0000","last_active":"2024-09-18T12:57:44.676078+0000","last_peered":"2024-09-18T12:57:44.676078+0000","last_clean":"2024-09-18T12:57:44.676078+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T12:57:44.676078+0000","last_undegraded":"2024-09-18T12:57:44.676078+0000","last_fullsized":"2024-09-18T12:57:44.676078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26968,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344872,"statfs":{"total":96636764160,"available":96609148928,"internally_reserved":0,"allocated":139264,"data_stored":36283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":196608,"data_stored":626632,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626651,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26964,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344876,"statfs":{"total":96636764160,"available":96609153024,"internally_reserved":0,"allocated":135168,"data_stored":36264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:57:47.271 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T12:57:47.271 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T12:57:47.271 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T12:57:47.271 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T12:57:47.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.373+0000 7f8f01591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:47.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.377+0000 7f8f01591640 1 Processor -- start 2024-09-18T12:57:47.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.377+0000 7f8f01591640 1 -- start start 2024-09-18T12:57:47.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.378+0000 7f8f01591640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8efc138fd0 0x7f8efc13b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:47.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.378+0000 7f8f01591640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8efc136c10 con 0x7f8efc1360f0 2024-09-18T12:57:47.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.378+0000 7f8f01591640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc0a6010 con 0x7f8efc138fd0 2024-09-18T12:57:47.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.378+0000 7f8efaffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8efc1360f0 0x7f8efc136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34438/0 (socket says 172.21.15.120:34438) 2024-09-18T12:57:47.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.378+0000 7f8efaffd640 1 -- 172.21.15.120:0/3054407361 learned_addr learned my addr 172.21.15.120:0/3054407361 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.378+0000 7f8efa7fc640 1 --2- 172.21.15.120:0/3054407361 >> v2:172.21.15.120:3300/0 conn(0x7f8efc138fd0 0x7f8efc13b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8ef9ffb640 1 -- 172.21.15.120:0/3054407361 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103441479 0 0) 0x7f8eec001110 con 0x7f8efc1360f0 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8ef9ffb640 1 -- 172.21.15.120:0/3054407361 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ee4003580 con 0x7f8efc1360f0 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8efa7fc640 1 -- 172.21.15.120:0/3054407361 >> v1:172.21.15.120:6789/0 conn(0x7f8efc1360f0 legacy=0x7f8efc136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8efa7fc640 1 -- 172.21.15.120:0/3054407361 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc0a5c40 con 0x7f8efc138fd0 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8efa7fc640 1 --2- 172.21.15.120:0/3054407361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc138fd0 0x7f8efc13b3f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b9d40ca73c6c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8ef9ffb640 1 -- 172.21.15.120:0/3054407361 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef0009d90 con 0x7f8efc138fd0 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8ef9ffb640 1 -- 172.21.15.120:0/3054407361 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ef000e230 con 0x7f8efc138fd0 2024-09-18T12:57:47.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.379+0000 7f8ef9ffb640 1 -- 172.21.15.120:0/3054407361 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef000e4d0 con 0x7f8efc138fd0 2024-09-18T12:57:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 1 -- 172.21.15.120:0/3054407361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc138fd0 msgr2=0x7f8efc13b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 1 --2- 172.21.15.120:0/3054407361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc138fd0 0x7f8efc13b3f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 1 -- 172.21.15.120:0/3054407361 shutdown_connections 2024-09-18T12:57:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 1 --2- 172.21.15.120:0/3054407361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc138fd0 0x7f8efc13b3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 1 -- 172.21.15.120:0/3054407361 >> 172.21.15.120:0/3054407361 conn(0x7f8efc06f850 msgr2=0x7f8efc09ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 1 -- 172.21.15.120:0/3054407361 shutdown_connections 2024-09-18T12:57:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 1 -- 172.21.15.120:0/3054407361 wait complete. 2024-09-18T12:57:47.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.380+0000 7f8f01591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T12:57:47.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.382+0000 7f8f01591640 1 Processor -- start 2024-09-18T12:57:47.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.382+0000 7f8f01591640 1 -- start start 2024-09-18T12:57:47.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8f01591640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc1360f0 0x7f8efc1ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8f01591640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc125670 con 0x7f8efc1360f0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8efaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc1360f0 0x7f8efc1ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8efaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc1360f0 0x7f8efc1ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55282/0 (socket says 172.21.15.120:55282) 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8efaffd640 1 -- 172.21.15.120:0/3461905825 learned_addr learned my addr 172.21.15.120:0/3461905825 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8efaffd640 1 -- 172.21.15.120:0/3461905825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc121a20 con 0x7f8efc1360f0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8efaffd640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc1360f0 0x7f8efc1ca950 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8ee37fe640 1 -- 172.21.15.120:0/3461905825 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8eec005930 con 0x7f8efc1360f0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8ee37fe640 1 -- 172.21.15.120:0/3461905825 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8eec005a90 con 0x7f8efc1360f0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8ee37fe640 1 -- 172.21.15.120:0/3461905825 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8eec005d30 con 0x7f8efc1360f0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc1230f0 con 0x7f8efc1360f0 2024-09-18T12:57:47.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.383+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc1239a0 con 0x7f8efc1360f0 2024-09-18T12:57:47.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.384+0000 7f8ee37fe640 1 -- 172.21.15.120:0/3461905825 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8eec00c800 con 0x7f8efc1360f0 2024-09-18T12:57:47.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.384+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8efc0a0340 con 0x7f8efc1360f0 2024-09-18T12:57:47.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.384+0000 7f8ee37fe640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ee803e910 0x7f8ee8040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:47.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.385+0000 7f8ee37fe640 1 -- 172.21.15.120:0/3461905825 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2728+0+0 (crc 0 0 0) 0x7f8eec04f5e0 con 0x7f8efc1360f0 2024-09-18T12:57:47.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.385+0000 7f8efa7fc640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ee803e910 0x7f8ee8040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:47.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.385+0000 7f8efa7fc640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ee803e910 0x7f8ee8040e20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:47.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.390+0000 7f8ee37fe640 1 -- 172.21.15.120:0/3461905825 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f8eec00dc60 con 0x7f8efc1360f0 2024-09-18T12:57:47.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.604+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8efc136c10 con 0x7f8efc1360f0 2024-09-18T12:57:47.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.605+0000 7f8ee37fe640 1 -- 172.21.15.120:0/3461905825 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7f8efc136c10 con 0x7f8efc1360f0 2024-09-18T12:57:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T12:57:47.606 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ee803e910 msgr2=0x7f8ee8040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ee803e910 0x7f8ee8040e20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc1360f0 msgr2=0x7f8efc1ca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc1360f0 0x7f8efc1ca950 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 shutdown_connections 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ee803e910 0x7f8ee8040e20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 --2- 172.21.15.120:0/3461905825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc1360f0 0x7f8efc1ca950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 >> 172.21.15.120:0/3461905825 conn(0x7f8efc06f850 msgr2=0x7f8efc1be300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 shutdown_connections 2024-09-18T12:57:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T12:57:47.607+0000 7f8f01591640 1 -- 172.21.15.120:0/3461905825 wait complete. 2024-09-18T12:57:47.619 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T12:57:47.619 INFO:teuthology.run_tasks:Running task workunit... 2024-09-18T12:57:47.635 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-18T12:57:47.636 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-18T12:57:47.636 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:57:47.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:57:47.652 INFO:teuthology.orchestra.run.smithi120.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-18T12:57:47.652 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:57:47.707 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-18T12:57:47.708 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-18T12:57:47.763 INFO:tasks.workunit:timeout=3h 2024-09-18T12:57:47.763 INFO:tasks.workunit:cleanup=True 2024-09-18T12:57:47.764 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-18T12:57:47.821 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-18T12:58:39.867 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-18T12:58:39.868 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-18T12:58:39.868 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:58:39.868 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:58:39.868 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:58:39.868 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-18T12:58:39.868 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:58:39.868 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-18T12:58:39.869 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-18T12:58:39.871 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-18T12:58:39.937 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:58:39.939 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:58:39.939 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:58:40.593 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:58:40.662 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:58:40.701 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:58:40.703 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:58:40.703 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:58:40.741 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:58:40.744 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-18T12:58:40.744 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-18T12:58:40.801 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-18T12:58:40.802 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-18T12:58:40.803 DEBUG:teuthology.orchestra.run.smithi120:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-18T12:58:40.861 INFO:tasks.workunit.client.0.smithi120.stderr:+ parallel=1 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' --crimson = --serial ']' 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ crimson=0 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' --crimson = --crimson ']' 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ parallel=0 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ crimson=1 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ color= 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -t 1 ']' 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-18T12:58:40.862 INFO:tasks.workunit.client.0.smithi120.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-18T12:58:40.863 INFO:tasks.workunit.client.0.smithi120.stderr:+ declare -A pids 2024-09-18T12:58:40.863 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T12:58:40.863 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T12:58:40.863 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_aio 2024-09-18T12:58:40.880 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T12:58:40.880 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-18T12:58:40.880 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T12:58:40.880 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 26 tests from LibRadosAio 2024-09-18T12:58:40.880 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-18T12:58:43.293 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.TooBig (2414 ms) 2024-09-18T12:58:43.293 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-18T12:58:46.302 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.SimpleWrite (3009 ms) 2024-09-18T12:58:46.302 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-18T12:58:49.320 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.WaitForSafe (3017 ms) 2024-09-18T12:58:49.320 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-18T12:58:52.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTrip (3012 ms) 2024-09-18T12:58:52.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-18T12:58:55.351 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTrip2 (3020 ms) 2024-09-18T12:58:55.352 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-18T12:58:58.361 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTrip3 (3009 ms) 2024-09-18T12:58:58.361 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-18T12:59:01.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripAppend (3022 ms) 2024-09-18T12:59:01.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-18T12:59:04.393 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RemoveTest (3010 ms) 2024-09-18T12:59:04.393 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-18T12:59:07.408 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3016 ms) 2024-09-18T12:59:07.408 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-18T12:59:10.421 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RmXattr (3013 ms) 2024-09-18T12:59:10.421 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-18T12:59:13.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.XattrIter (3017 ms) 2024-09-18T12:59:13.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-18T12:59:16.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.IsComplete (3009 ms) 2024-09-18T12:59:16.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-18T12:59:19.463 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.IsSafe (3016 ms) 2024-09-18T12:59:19.463 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-18T12:59:22.479 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.ReturnValue (3015 ms) 2024-09-18T12:59:22.479 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.Flush 2024-09-18T12:59:25.496 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.Flush (3017 ms) 2024-09-18T12:59:25.496 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-18T12:59:28.511 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.FlushAsync (3016 ms) 2024-09-18T12:59:28.511 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-18T12:59:31.525 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3014 ms) 2024-09-18T12:59:31.525 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-18T12:59:34.546 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3021 ms) 2024-09-18T12:59:34.546 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-18T12:59:37.280 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.SimpleStat (2734 ms) 2024-09-18T12:59:37.280 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-18T12:59:40.281 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.OperateMtime (3001 ms) 2024-09-18T12:59:40.282 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-18T12:59:43.302 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.Operate2Mtime (3020 ms) 2024-09-18T12:59:43.302 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-18T12:59:46.318 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.SimpleStatNS (3016 ms) 2024-09-18T12:59:46.319 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-18T12:59:49.337 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.StatRemove (3019 ms) 2024-09-18T12:59:49.337 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-18T12:59:52.338 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.ExecuteClass (3001 ms) 2024-09-18T12:59:52.339 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-18T12:59:55.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.MultiWrite (3010 ms) 2024-09-18T12:59:55.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-18T12:59:58.366 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.AioUnlock (3015 ms) 2024-09-18T12:59:58.366 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 26 tests from LibRadosAio (77484 ms total) 2024-09-18T12:59:58.366 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1100: Skipped 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1132: Skipped 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-18T12:59:58.367 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1149: Skipped 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1182: Skipped 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1215: Skipped 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1286: Skipped 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1326: Skipped 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1366: Skipped 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1385: Skipped 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1415: Skipped 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1454: Skipped 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1498: Skipped 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1532: Skipped 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1593: Skipped 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-18T12:59:58.371 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1649: Skipped 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio.cc:1681: Skipped 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 42 tests from 2 test suites ran. (77484 ms total) 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 26 tests. 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-18T12:59:58.372 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-18T12:59:58.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-18T12:59:58.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-18T12:59:58.374 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T12:59:58.374 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T12:59:58.374 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_aio_pp 2024-09-18T12:59:58.389 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T12:59:58.389 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-18T12:59:58.389 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T12:59:58.389 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 32 tests from LibRadosAio 2024-09-18T12:59:58.389 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-18T13:00:01.289 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.TooBigPP (2900 ms) 2024-09-18T13:00:01.290 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-18T13:00:17.311 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.PoolQuotaPP (16021 ms) 2024-09-18T13:00:17.311 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-18T13:00:23.343 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.SimpleWritePP (6033 ms) 2024-09-18T13:00:23.343 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-18T13:00:26.352 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.WaitForSafePP (3009 ms) 2024-09-18T13:00:26.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-18T13:00:29.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripPP (3016 ms) 2024-09-18T13:00:29.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-18T13:00:32.392 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3024 ms) 2024-09-18T13:00:32.392 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-18T13:00:35.291 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2899 ms) 2024-09-18T13:00:35.291 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-18T13:00:38.300 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3009 ms) 2024-09-18T13:00:38.301 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-18T13:00:41.314 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.IsCompletePP (3013 ms) 2024-09-18T13:00:41.314 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-18T13:00:44.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.IsSafePP (3013 ms) 2024-09-18T13:00:44.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-18T13:00:47.337 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.ReturnValuePP (3011 ms) 2024-09-18T13:00:47.337 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-18T13:00:50.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.FlushPP (3012 ms) 2024-09-18T13:00:50.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-18T13:00:53.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3020 ms) 2024-09-18T13:00:53.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-18T13:00:56.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3013 ms) 2024-09-18T13:00:56.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-18T13:00:59.394 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3012 ms) 2024-09-18T13:00:59.394 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-18T13:01:02.405 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3011 ms) 2024-09-18T13:01:02.406 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-18T13:01:05.298 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2893 ms) 2024-09-18T13:01:05.299 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-18T13:01:08.305 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3007 ms) 2024-09-18T13:01:08.305 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-18T13:01:11.322 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.SimpleStatPP (3016 ms) 2024-09-18T13:01:11.322 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-18T13:01:14.337 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.OperateMtime (3015 ms) 2024-09-18T13:01:14.337 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-18T13:01:17.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.OperateMtime2 (3012 ms) 2024-09-18T13:01:17.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-18T13:01:20.364 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.StatRemovePP (3013 ms) 2024-09-18T13:01:20.364 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-18T13:01:23.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3013 ms) 2024-09-18T13:01:23.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-18T13:01:26.388 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.OmapPP (3013 ms) 2024-09-18T13:01:26.388 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-18T13:01:29.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.MultiWritePP (3032 ms) 2024-09-18T13:01:29.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-18T13:01:32.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.AioUnlockPP (3009 ms) 2024-09-18T13:01:32.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-18T13:01:35.301 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2873 ms) 2024-09-18T13:01:35.302 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-18T13:01:38.308 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RacingRemovePP (3006 ms) 2024-09-18T13:01:38.308 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-18T13:01:41.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3018 ms) 2024-09-18T13:01:41.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-18T13:01:44.336 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3010 ms) 2024-09-18T13:01:44.336 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-18T13:01:46.803 INFO:tasks.workunit.client.0.smithi120.stdout:setting pool EIO 2024-09-18T13:01:56.477 INFO:tasks.workunit.client.0.smithi120.stdout:waiting for 895 2024-09-18T13:01:57.477 INFO:tasks.workunit.client.0.smithi120.stdout:waiting for 895 2024-09-18T13:01:58.477 INFO:tasks.workunit.client.0.smithi120.stdout:waiting for 895 2024-09-18T13:01:59.477 INFO:tasks.workunit.client.0.smithi120.stdout:max_success 105, min_failed 106 2024-09-18T13:01:59.702 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAio.PoolEIOFlag (15367 ms) 2024-09-18T13:01:59.702 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-18T13:01:59.703 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-18T13:01:59.703 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:01:59.703 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-18T13:01:59.703 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 32 tests from LibRadosAio (121313 ms total) 2024-09-18T13:01:59.703 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:01:59.703 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-18T13:01:59.703 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-18T13:02:02.319 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (2617 ms) 2024-09-18T13:02:02.319 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-18T13:02:11.312 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8993 ms) 2024-09-18T13:02:11.312 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-18T13:02:26.410 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15098 ms) 2024-09-18T13:02:26.411 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-18T13:02:29.424 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3014 ms) 2024-09-18T13:02:29.424 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosAioPP (29722 ms total) 2024-09-18T13:02:29.424 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:29.424 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosIoPP 2024-09-18T13:02:29.425 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-18T13:02:32.324 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.XattrListPP (2897 ms) 2024-09-18T13:02:32.324 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosIoPP (2897 ms total) 2024-09-18T13:02:32.324 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:32.324 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-18T13:02:32.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-18T13:02:32.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-18T13:02:32.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-18T13:02:32.329 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:32.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 20 tests from LibRadosAioEC (1 ms total) 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 57 tests from 4 test suites ran. (153933 ms total) 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 36 tests. 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-18T13:02:32.331 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-18T13:02:32.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-18T13:02:32.333 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:02:32.333 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:02:32.333 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_io 2024-09-18T13:02:32.346 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:02:32.346 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-18T13:02:32.346 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:02:32.346 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from LibRadosIo 2024-09-18T13:02:34.332 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-18T13:02:34.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.SimpleWrite (297 ms) 2024-09-18T13:02:34.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-18T13:02:34.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-18T13:02:34.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-18T13:02:34.697 INFO:tasks.workunit.client.0.smithi120.stdout:no timeout :/ 2024-09-18T13:02:34.697 INFO:tasks.workunit.client.0.smithi120.stdout:no timeout :/ 2024-09-18T13:02:34.697 INFO:tasks.workunit.client.0.smithi120.stdout:no timeout :/ 2024-09-18T13:02:34.698 INFO:tasks.workunit.client.0.smithi120.stdout:no timeout :/ 2024-09-18T13:02:34.698 INFO:tasks.workunit.client.0.smithi120.stdout:no timeout :/ 2024-09-18T13:02:34.698 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.ReadTimeout (68 ms) 2024-09-18T13:02:34.698 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-18T13:02:34.732 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.RoundTrip (35 ms) 2024-09-18T13:02:34.733 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-18T13:02:34.750 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.Checksum (18 ms) 2024-09-18T13:02:34.750 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-18T13:02:34.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (34 ms) 2024-09-18T13:02:34.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-18T13:02:34.814 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (30 ms) 2024-09-18T13:02:34.814 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-18T13:02:34.845 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.AppendRoundTrip (31 ms) 2024-09-18T13:02:34.845 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-18T13:02:34.854 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.ZeroLenZero (9 ms) 2024-09-18T13:02:34.854 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-18T13:02:34.884 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.TruncTest (29 ms) 2024-09-18T13:02:34.884 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-18T13:02:34.911 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.RemoveTest (28 ms) 2024-09-18T13:02:34.911 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-18T13:02:34.945 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (34 ms) 2024-09-18T13:02:34.945 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-18T13:02:35.027 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.RmXattr (82 ms) 2024-09-18T13:02:35.027 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-18T13:02:35.068 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIo.XattrIter (41 ms) 2024-09-18T13:02:35.347 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from LibRadosIo (736 ms total) 2024-09-18T13:02:35.347 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:35.347 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-18T13:02:35.347 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:168: Skipped 2024-09-18T13:02:35.347 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-18T13:02:35.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.350 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.351 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:176: Skipped 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 24 tests from 2 test suites ran. (2998 ms total) 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 14 tests. 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-18T13:02:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-18T13:02:35.353 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-18T13:02:35.354 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:02:35.354 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:02:35.354 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_io_pp 2024-09-18T13:02:35.367 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:02:35.367 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-18T13:02:35.367 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:02:35.367 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-18T13:02:35.367 INFO:tasks.workunit.client.0.smithi120.stdout:seed 31535 2024-09-18T13:02:37.357 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-18T13:02:37.357 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.TooBigPP (1 ms) 2024-09-18T13:02:37.357 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-18T13:02:37.603 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (246 ms) 2024-09-18T13:02:37.604 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-18T13:02:37.676 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.ReadOpPP (73 ms) 2024-09-18T13:02:37.676 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-18T13:02:37.697 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (21 ms) 2024-09-18T13:02:37.697 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-18T13:02:40.570 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2873 ms) 2024-09-18T13:02:40.571 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-18T13:02:40.592 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.RoundTripPP (22 ms) 2024-09-18T13:02:40.592 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-18T13:02:40.611 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (19 ms) 2024-09-18T13:02:40.611 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-18T13:02:40.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.Checksum (18 ms) 2024-09-18T13:02:40.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-18T13:02:40.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (21 ms) 2024-09-18T13:02:40.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-18T13:02:40.678 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (28 ms) 2024-09-18T13:02:40.678 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-18T13:02:40.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (34 ms) 2024-09-18T13:02:40.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-18T13:02:40.731 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (19 ms) 2024-09-18T13:02:40.731 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-18T13:02:40.768 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (37 ms) 2024-09-18T13:02:40.768 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-18T13:02:40.798 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.TruncTestPP (30 ms) 2024-09-18T13:02:40.799 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-18T13:02:40.824 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (26 ms) 2024-09-18T13:02:40.824 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-18T13:02:40.856 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (32 ms) 2024-09-18T13:02:40.856 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-18T13:02:40.949 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.RmXattrPP (92 ms) 2024-09-18T13:02:40.949 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-18T13:02:40.988 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.XattrListPP (40 ms) 2024-09-18T13:02:40.988 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-18T13:02:41.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (28 ms) 2024-09-18T13:02:41.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-18T13:02:41.047 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.CmpExtPP (31 ms) 2024-09-18T13:02:41.047 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-18T13:02:41.066 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (20 ms) 2024-09-18T13:02:41.067 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-18T13:02:41.094 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (27 ms) 2024-09-18T13:02:41.372 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 22 tests from LibRadosIoPP (3738 ms total) 2024-09-18T13:02:41.372 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:41.372 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-18T13:02:41.372 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.373 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-18T13:02:41.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-18T13:02:41.375 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.376 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-18T13:02:41.377 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.379 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.380 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 40 tests from 2 test suites ran. (6002 ms total) 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 22 tests. 2024-09-18T13:02:41.381 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-18T13:02:41.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-18T13:02:41.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-18T13:02:41.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-18T13:02:41.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-18T13:02:41.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-18T13:02:41.383 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:02:41.383 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:02:41.383 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_asio 2024-09-18T13:02:41.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.410+0000 7f7e6ee896c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:02:41.425 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-18T13:02:41.425 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:02:41.425 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 12 tests from AsioRados 2024-09-18T13:02:41.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.423+0000 7f7e6ee896c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:02:41.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.423+0000 7f7e6ee896c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:02:41.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.424+0000 7f7e6ee896c0 1 Processor -- start 2024-09-18T13:02:41.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.424+0000 7f7e6ee896c0 1 -- start start 2024-09-18T13:02:41.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.426+0000 7f7e6ee896c0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x163c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:41.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.426+0000 7f7e6ee896c0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x15bf520 con 0x1665180 2024-09-18T13:02:41.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.426+0000 7f7e66a3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x163c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:41.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.427+0000 7f7e66a3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x163c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55674/0 (socket says 172.21.15.120:55674) 2024-09-18T13:02:41.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.427+0000 7f7e66a3e640 1 -- 172.21.15.120:0/3449229921 learned_addr learned my addr 172.21.15.120:0/3449229921 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:02:41.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.427+0000 7f7e66a3e640 1 -- 172.21.15.120:0/3449229921 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x155be10 con 0x1665180 2024-09-18T13:02:41.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.427+0000 7f7e66a3e640 1 --2- 172.21.15.120:0/3449229921 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x163c1c0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19072cea680f569c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:41.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.428+0000 7f7e6523b640 1 -- 172.21.15.120:0/3449229921 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7e5802daf0 con 0x1665180 2024-09-18T13:02:41.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.428+0000 7f7e6523b640 1 -- 172.21.15.120:0/3449229921 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7e5802dc50 con 0x1665180 2024-09-18T13:02:41.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.428+0000 7f7e6523b640 1 -- 172.21.15.120:0/3449229921 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7e58037370 con 0x1665180 2024-09-18T13:02:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.430+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3449229921 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 msgr2=0x163c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.430+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3449229921 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x163c1c0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.430+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3449229921 shutdown_connections 2024-09-18T13:02:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.430+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3449229921 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x163c1c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.430+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3449229921 >> 172.21.15.120:0/3449229921 conn(0x157f770 msgr2=0x1668d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.430+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3449229921 shutdown_connections 2024-09-18T13:02:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.430+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3449229921 wait complete. 2024-09-18T13:02:41.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.431+0000 7f7e6ee896c0 1 Processor -- start 2024-09-18T13:02:41.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.432+0000 7f7e6ee896c0 1 -- start start 2024-09-18T13:02:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.433+0000 7f7e6ee896c0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x1638cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.433+0000 7f7e6ee896c0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x15bd280 con 0x1665180 2024-09-18T13:02:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.433+0000 7f7e66a3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x1638cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e66a3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x1638cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55684/0 (socket says 172.21.15.120:55684) 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e66a3e640 1 -- 172.21.15.120:0/3205584825 learned_addr learned my addr 172.21.15.120:0/3205584825 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e66a3e640 1 -- 172.21.15.120:0/3205584825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x154d920 con 0x1665180 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e66a3e640 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x1638cc0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7e5803e040 con 0x1665180 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7e580057c0 con 0x1665180 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x154d380 con 0x1665180 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7e58039cf0 con 0x1665180 2024-09-18T13:02:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.434+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x16540d0 con 0x1665180 2024-09-18T13:02:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.436+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7e58006380 con 0x1665180 2024-09-18T13:02:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.436+0000 7f7e4ffff640 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7e5403d210 0x7f7e5403f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.436+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(237..237 src has 1..237) ==== 2700+0+0 (crc 0 0 0) 0x7f7e58032040 con 0x1665180 2024-09-18T13:02:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.436+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x15b5df0 con 0x1665180 2024-09-18T13:02:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.436+0000 7f7e6623d640 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7e5403d210 0x7f7e5403f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:41.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.436+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=237) ==== 24+0+0 (crc 0 0 0) 0x7f7e58039ea0 con 0x1665180 2024-09-18T13:02:41.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.436+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x15c8bf0 con 0x1665180 2024-09-18T13:02:41.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:41.437+0000 7f7e6623d640 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7e5403d210 0x7f7e5403f720 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:42.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:42.370+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v238) ==== 43+0+0 (crc 0 0 0) 0x7f7e58037700 con 0x1665180 2024-09-18T13:02:42.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:42.370+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=238}) -- 0x7f7e54041b90 con 0x1665180 2024-09-18T13:02:42.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:42.370+0000 7f7e4ffff640 1 -- 172.21.15.120:0/3205584825 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(238..238 src has 1..238) ==== 651+0+0 (crc 0 0 0) 0x7f7e5803ce40 con 0x1665180 2024-09-18T13:02:42.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:42.370+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3205584825 >> v2:172.21.15.176:6806/2606993558 conn(0x16f62a0 0x17913b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:42.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:42.370+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x1654a30 con 0x16f62a0 2024-09-18T13:02:42.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:42.376+0000 7f7e6723f640 1 --2- 172.21.15.120:0/3205584825 >> v2:172.21.15.176:6806/2606993558 conn(0x16f62a0 0x17913b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:02:42.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:42.417+0000 7f7e6723f640 1 --2- 172.21.15.120:0/3205584825 >> v2:172.21.15.176:6806/2606993558 conn(0x16f62a0 0x17913b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:43.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.620+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(2 exist [writefull 0~5] v239'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.621 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-18T13:02:43.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.620+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x178bf60 con 0x16f62a0 2024-09-18T13:02:43.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.620+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x178c7e0 con 0x16f62a0 2024-09-18T13:02:43.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.627+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.627+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncReadCallback (8 ms) 2024-09-18T13:02:43.629 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-18T13:02:43.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.627+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x178cb90 con 0x16f62a0 2024-09-18T13:02:43.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.628+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x17918f0 con 0x16f62a0 2024-09-18T13:02:43.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.635+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.635+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.636 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncReadFuture (8 ms) 2024-09-18T13:02:43.636 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-18T13:02:43.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.635+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x178c310 con 0x16f62a0 2024-09-18T13:02:43.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.635+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x17d2120 con 0x16f62a0 2024-09-18T13:02:43.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.642+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.642+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.643 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncReadYield (6 ms) 2024-09-18T13:02:43.643 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-18T13:02:43.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.642+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x1792c60 con 0x16f62a0 2024-09-18T13:02:43.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.657+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 8 ==== osd_op_reply(9 exist [write 0~5] v239'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.658 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncWriteCallback (15 ms) 2024-09-18T13:02:43.658 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-18T13:02:43.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.657+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x1792c60 con 0x16f62a0 2024-09-18T13:02:43.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.668+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 9 ==== osd_op_reply(10 exist [write 0~5] v239'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.669 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncWriteFuture (11 ms) 2024-09-18T13:02:43.670 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-18T13:02:43.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.668+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x17b4c70 con 0x16f62a0 2024-09-18T13:02:43.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.679+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 10 ==== osd_op_reply(11 exist [write 0~5] v239'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.680 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncWriteYield (11 ms) 2024-09-18T13:02:43.680 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-18T13:02:43.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.679+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x1791c50 con 0x16f62a0 2024-09-18T13:02:43.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.679+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x17925b0 con 0x16f62a0 2024-09-18T13:02:43.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.686+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.686+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.687 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (7 ms) 2024-09-18T13:02:43.687 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-18T13:02:43.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.686+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x1791c50 con 0x16f62a0 2024-09-18T13:02:43.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.686+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x17925b0 con 0x16f62a0 2024-09-18T13:02:43.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.693+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.693+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.695 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (7 ms) 2024-09-18T13:02:43.695 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-18T13:02:43.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.693+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x1791c50 con 0x16f62a0 2024-09-18T13:02:43.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.693+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x17925b0 con 0x16f62a0 2024-09-18T13:02:43.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.700+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.700+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.701 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2024-09-18T13:02:43.701 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-18T13:02:43.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.700+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x1791c50 con 0x16f62a0 2024-09-18T13:02:43.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.710+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 17 ==== osd_op_reply(18 exist [writefull 0~5] v239'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (12 ms) 2024-09-18T13:02:43.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-18T13:02:43.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.710+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x1791c50 con 0x16f62a0 2024-09-18T13:02:43.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.722+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 18 ==== osd_op_reply(19 exist [writefull 0~5] v239'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.724 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (12 ms) 2024-09-18T13:02:43.724 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-18T13:02:43.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.722+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x1791c50 con 0x16f62a0 2024-09-18T13:02:43.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6723f640 1 -- 172.21.15.120:0/3205584825 <== osd.3 v2:172.21.15.176:6806/2606993558 19 ==== osd_op_reply(20 exist [writefull 0~5] v239'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7e6000a430 con 0x16f62a0 2024-09-18T13:02:43.735 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (11 ms) 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 >> v2:172.21.15.176:6806/2606993558 conn(0x16f62a0 msgr2=0x17913b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3205584825 >> v2:172.21.15.176:6806/2606993558 conn(0x16f62a0 0x17913b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7e5403d210 msgr2=0x7f7e5403f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7e5403d210 0x7f7e5403f720 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 msgr2=0x1638cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x1638cc0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 shutdown_connections 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3205584825 >> v2:172.21.15.176:6806/2606993558 conn(0x16f62a0 0x17913b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7e5403d210 0x7f7e5403f720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:43.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 --2- 172.21.15.120:0/3205584825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1665180 0x1638cc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 >> 172.21.15.120:0/3205584825 conn(0x157f770 msgr2=0x16f1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 shutdown_connections 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.733+0000 7f7e6ee896c0 1 -- 172.21.15.120:0/3205584825 wait complete. 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 12 tests from AsioRados (115 ms total) 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 12 tests from 1 test suite ran. (2311 ms total) 2024-09-18T13:02:43.737 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 12 tests. 2024-09-18T13:02:43.738 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:02:43.738 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:02:43.738 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_list 2024-09-18T13:02:43.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.765+0000 7f3fb88339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:02:43.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.765+0000 7f3fb88339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:02:43.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:02:43.765+0000 7f3fb88339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:02:43.768 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-18T13:02:43.768 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:02:43.768 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from LibRadosList 2024-09-18T13:02:45.380 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-18T13:02:45.891 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosList.ListObjects (511 ms) 2024-09-18T13:02:45.891 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-18T13:02:46.103 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (212 ms) 2024-09-18T13:02:46.103 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-18T13:02:46.204 INFO:tasks.workunit.client.0.smithi120.stdout:myset foo1,foo2,foo3 2024-09-18T13:02:46.300 INFO:tasks.workunit.client.0.smithi120.stdout:foo1 2024-09-18T13:02:46.300 INFO:tasks.workunit.client.0.smithi120.stdout:foo2 2024-09-18T13:02:46.300 INFO:tasks.workunit.client.0.smithi120.stdout:foo3 2024-09-18T13:02:46.300 INFO:tasks.workunit.client.0.smithi120.stdout:myset foo1,foo4,foo5 2024-09-18T13:02:46.397 INFO:tasks.workunit.client.0.smithi120.stdout:foo4 2024-09-18T13:02:46.397 INFO:tasks.workunit.client.0.smithi120.stdout:foo5 2024-09-18T13:02:46.397 INFO:tasks.workunit.client.0.smithi120.stdout:foo1 2024-09-18T13:02:46.398 INFO:tasks.workunit.client.0.smithi120.stdout:myset foo6,foo7 2024-09-18T13:02:46.515 INFO:tasks.workunit.client.0.smithi120.stdout:foo7 2024-09-18T13:02:46.515 INFO:tasks.workunit.client.0.smithi120.stdout:foo6 2024-09-18T13:02:46.516 INFO:tasks.workunit.client.0.smithi120.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-18T13:02:46.611 INFO:tasks.workunit.client.0.smithi120.stdout:ns1:foo4 2024-09-18T13:02:46.612 INFO:tasks.workunit.client.0.smithi120.stdout:ns1:foo5 2024-09-18T13:02:46.612 INFO:tasks.workunit.client.0.smithi120.stdout:ns2:foo7 2024-09-18T13:02:46.612 INFO:tasks.workunit.client.0.smithi120.stdout:ns2:foo6 2024-09-18T13:02:46.612 INFO:tasks.workunit.client.0.smithi120.stdout:ns1:foo1 2024-09-18T13:02:46.612 INFO:tasks.workunit.client.0.smithi120.stdout::foo1 2024-09-18T13:02:46.612 INFO:tasks.workunit.client.0.smithi120.stdout::foo2 2024-09-18T13:02:46.612 INFO:tasks.workunit.client.0.smithi120.stdout::foo3 2024-09-18T13:02:46.796 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosList.ListObjectsNS (693 ms) 2024-09-18T13:02:46.796 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-18T13:02:47.096 INFO:tasks.workunit.client.0.smithi120.stdout:1 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:10 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:13 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:7 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:14 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:0 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:15 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:11 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:5 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:8 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:6 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:3 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:4 0 2024-09-18T13:02:47.097 INFO:tasks.workunit.client.0.smithi120.stdout:12 0 2024-09-18T13:02:47.098 INFO:tasks.workunit.client.0.smithi120.stdout:9 0 2024-09-18T13:02:47.098 INFO:tasks.workunit.client.0.smithi120.stdout:2 0 2024-09-18T13:02:47.192 INFO:tasks.workunit.client.0.smithi120.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-18T13:02:47.466 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosList.ListObjectsStart (670 ms) 2024-09-18T13:02:47.467 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-18T13:02:47.656 INFO:tasks.workunit.client.0.smithi120.stdout:x cursor=MIN 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-18T13:02:47.754 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-18T13:02:47.755 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-18T13:02:47.755 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-18T13:02:47.755 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-18T13:02:47.755 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-18T13:02:47.755 INFO:tasks.workunit.client.0.smithi120.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-18T13:02:47.851 INFO:tasks.workunit.client.0.smithi120.stdout:FIRST> seek to MIN oid=1 2024-09-18T13:02:47.948 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-18T13:02:47.948 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:02547ec2:::1:head 2024-09-18T13:02:48.045 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:02547ec2:::1:head -> 1 2024-09-18T13:02:48.045 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-18T13:02:48.045 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:52ea6a34:::10:head 2024-09-18T13:02:48.112 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-18T13:02:48.112 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-18T13:02:48.112 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:566253c9:::13:head 2024-09-18T13:02:48.178 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:566253c9:::13:head -> 13 2024-09-18T13:02:48.178 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-18T13:02:48.178 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-18T13:02:48.239 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-18T13:02:48.239 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-18T13:02:48.239 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:62a1935d:::14:head 2024-09-18T13:02:48.304 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:62a1935d:::14:head -> 14 2024-09-18T13:02:48.304 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-18T13:02:48.304 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:6cac518f:::0:head 2024-09-18T13:02:48.360 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:6cac518f:::0:head -> 0 2024-09-18T13:02:48.360 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-18T13:02:48.360 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:863748b0:::15:head 2024-09-18T13:02:48.406 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:863748b0:::15:head -> 15 2024-09-18T13:02:48.406 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-18T13:02:48.406 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:89d3ae78:::11:head 2024-09-18T13:02:48.449 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-18T13:02:48.449 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-18T13:02:48.450 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:b29083e3:::5:head 2024-09-18T13:02:48.478 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:b29083e3:::5:head -> 5 2024-09-18T13:02:48.478 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-18T13:02:48.478 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-18T13:02:48.505 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-18T13:02:48.505 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-18T13:02:48.505 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-18T13:02:48.528 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-18T13:02:48.528 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-18T13:02:48.528 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:cfc208b3:::3:head 2024-09-18T13:02:48.549 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-18T13:02:48.549 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-18T13:02:48.549 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:d83876eb:::4:head 2024-09-18T13:02:48.564 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:d83876eb:::4:head -> 4 2024-09-18T13:02:48.564 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-18T13:02:48.564 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-18T13:02:48.579 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-18T13:02:48.579 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-18T13:02:48.579 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:e960b815:::9:head 2024-09-18T13:02:48.588 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:e960b815:::9:head -> 9 2024-09-18T13:02:48.589 INFO:tasks.workunit.client.0.smithi120.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-18T13:02:48.589 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:f905c69b:::2:head 2024-09-18T13:02:48.591 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:f905c69b:::2:head -> 2 2024-09-18T13:02:48.591 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:f905c69b:::2:head 2024-09-18T13:02:48.591 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-18T13:02:48.594 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:f905c69b:::2:head -> 2 2024-09-18T13:02:48.594 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=2 expected=2 2024-09-18T13:02:48.594 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:e960b815:::9:head 2024-09-18T13:02:48.594 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-18T13:02:48.603 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:e960b815:::9:head -> 9 2024-09-18T13:02:48.603 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=9 expected=9 2024-09-18T13:02:48.603 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:02547ec2:::1:head 2024-09-18T13:02:48.603 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-18T13:02:48.701 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:02547ec2:::1:head -> 1 2024-09-18T13:02:48.701 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=1 expected=1 2024-09-18T13:02:48.701 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-18T13:02:48.701 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-18T13:02:48.716 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-18T13:02:48.716 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=12 expected=12 2024-09-18T13:02:48.716 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:d83876eb:::4:head 2024-09-18T13:02:48.717 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-18T13:02:48.731 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:d83876eb:::4:head -> 4 2024-09-18T13:02:48.732 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=4 expected=4 2024-09-18T13:02:48.732 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:cfc208b3:::3:head 2024-09-18T13:02:48.732 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-18T13:02:48.753 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-18T13:02:48.753 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=3 expected=3 2024-09-18T13:02:48.753 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:89d3ae78:::11:head 2024-09-18T13:02:48.753 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-18T13:02:48.797 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-18T13:02:48.797 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=11 expected=11 2024-09-18T13:02:48.797 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:6cac518f:::0:head 2024-09-18T13:02:48.797 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-18T13:02:48.853 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:6cac518f:::0:head -> 0 2024-09-18T13:02:48.853 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=0 expected=0 2024-09-18T13:02:48.853 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:62a1935d:::14:head 2024-09-18T13:02:48.853 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-18T13:02:48.912 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:62a1935d:::14:head -> 14 2024-09-18T13:02:48.912 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=14 expected=14 2024-09-18T13:02:48.912 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-18T13:02:48.912 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-18T13:02:48.974 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-18T13:02:48.975 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=7 expected=7 2024-09-18T13:02:48.975 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:566253c9:::13:head 2024-09-18T13:02:48.975 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-18T13:02:49.040 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:566253c9:::13:head -> 13 2024-09-18T13:02:49.041 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=13 expected=13 2024-09-18T13:02:49.041 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-18T13:02:49.041 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-18T13:02:49.064 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-18T13:02:49.065 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=6 expected=6 2024-09-18T13:02:49.065 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-18T13:02:49.065 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-18T13:02:49.091 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-18T13:02:49.091 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=8 expected=8 2024-09-18T13:02:49.091 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:b29083e3:::5:head 2024-09-18T13:02:49.091 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-18T13:02:49.121 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:b29083e3:::5:head -> 5 2024-09-18T13:02:49.121 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=5 expected=5 2024-09-18T13:02:49.121 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:863748b0:::15:head 2024-09-18T13:02:49.121 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-18T13:02:49.167 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:863748b0:::15:head -> 15 2024-09-18T13:02:49.167 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=15 expected=15 2024-09-18T13:02:49.167 INFO:tasks.workunit.client.0.smithi120.stdout:: seek to 76:52ea6a34:::10:head 2024-09-18T13:02:49.167 INFO:tasks.workunit.client.0.smithi120.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-18T13:02:49.233 INFO:tasks.workunit.client.0.smithi120.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-18T13:02:49.233 INFO:tasks.workunit.client.0.smithi120.stdout:: entry=10 expected=10 2024-09-18T13:02:49.510 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosList.ListObjectsCursor (2043 ms) 2024-09-18T13:02:49.510 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-18T13:02:50.078 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosList.EnumerateObjects (569 ms) 2024-09-18T13:02:50.078 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-18T13:02:50.265 INFO:tasks.workunit.client.0.smithi120.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-18T13:02:50.287 INFO:tasks.workunit.client.0.smithi120.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-18T13:02:50.308 INFO:tasks.workunit.client.0.smithi120.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-18T13:02:50.331 INFO:tasks.workunit.client.0.smithi120.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-18T13:02:50.351 INFO:tasks.workunit.client.0.smithi120.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-18T13:02:50.643 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (565 ms) 2024-09-18T13:02:50.700 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from LibRadosList (5263 ms total) 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosListEC 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:70: Skipped 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:84: Skipped 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:96: Skipped 2024-09-18T13:02:50.701 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:84: Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:96: Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:84: Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:96: Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.702 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-18T13:02:50.703 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:78: Skipped 2024-09-18T13:02:50.703 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:50.703 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-18T13:02:50.703 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:50.703 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosListNP 2024-09-18T13:02:50.703 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosListNP.ListObjectsError (3011 ms) 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosListNP (3011 ms total) 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 11 tests from 3 test suites ran. (9944 ms total) 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 8 tests. 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-18T13:02:53.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-18T13:02:53.713 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-18T13:02:53.715 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:02:53.716 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:02:53.716 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_lock 2024-09-18T13:02:53.738 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:02:53.738 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-18T13:02:53.738 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:02:53.738 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLock 2024-09-18T13:02:55.315 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-18T13:02:55.584 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.LockExclusive (269 ms) 2024-09-18T13:02:55.584 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-18T13:02:55.608 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.LockShared (24 ms) 2024-09-18T13:02:55.608 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-18T13:02:56.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1042 ms) 2024-09-18T13:02:56.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-18T13:02:57.695 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.LockSharedDur (1045 ms) 2024-09-18T13:02:57.695 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-18T13:02:57.736 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.LockMayRenew (41 ms) 2024-09-18T13:02:57.736 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-18T13:02:57.777 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.Unlock (41 ms) 2024-09-18T13:02:57.777 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-18T13:02:57.831 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.ListLockers (54 ms) 2024-09-18T13:02:57.831 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-18T13:02:57.872 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLock.BreakLock (41 ms) 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLock (2557 ms total) 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:168: Skipped 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.325 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (1 ms) 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.326 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-18T13:02:58.328 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:176: Skipped 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLockEC (1 ms total) 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 16 tests from 2 test suites ran. (4586 ms total) 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 8 tests. 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-18T13:02:58.329 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-18T13:02:58.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-18T13:02:58.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-18T13:02:58.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-18T13:02:58.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-18T13:02:58.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-18T13:02:58.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-18T13:02:58.330 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-18T13:02:58.331 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:02:58.331 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:02:58.331 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_lock_pp 2024-09-18T13:02:58.352 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:02:58.352 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-18T13:02:58.352 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:02:58.352 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-18T13:02:58.352 INFO:tasks.workunit.client.0.smithi120.stdout:seed 31651 2024-09-18T13:03:00.319 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-18T13:03:00.573 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (254 ms) 2024-09-18T13:03:00.573 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-18T13:03:00.595 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.LockSharedPP (23 ms) 2024-09-18T13:03:00.595 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-18T13:03:01.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1055 ms) 2024-09-18T13:03:01.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-18T13:03:02.696 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1046 ms) 2024-09-18T13:03:02.696 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-18T13:03:02.742 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (45 ms) 2024-09-18T13:03:02.742 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-18T13:03:02.787 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.UnlockPP (46 ms) 2024-09-18T13:03:02.788 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-18T13:03:02.841 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.ListLockersPP (54 ms) 2024-09-18T13:03:02.841 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-18T13:03:02.874 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosLockPP.BreakLockPP (33 ms) 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLockPP (2556 ms total) 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.345 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.346 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.347 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.348 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:03:03.349 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 16 tests from 2 test suites ran. (4991 ms total) 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 8 tests. 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-18T13:03:03.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-18T13:03:03.351 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:03:03.351 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:03:03.351 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_misc 2024-09-18T13:03:03.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:03.396+0000 7ff557c356c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:03:03.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:03.396+0000 7ff557c356c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:03:03.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:03.401+0000 7ff557c356c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:03:03.402 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-18T13:03:03.402 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:03:03.402 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-18T13:03:03.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-18T13:03:03.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-18T13:03:03.403 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-18T13:03:03.403 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:03:03.403 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-18T13:03:03.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-18T13:03:03.466 INFO:tasks.workunit.client.0.smithi120.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-18T13:03:03.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:03.465+0000 7ff557c356c0 -1 failed for service _ceph-mon._tcp 2024-09-18T13:03:03.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:03.465+0000 7ff557c356c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-18T13:03:03.467 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (64 ms) 2024-09-18T13:03:03.467 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-18T13:03:08.474 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5008 ms) 2024-09-18T13:03:08.475 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5072 ms total) 2024-09-18T13:03:08.475 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:03:08.475 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-18T13:03:08.475 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-18T13:03:11.321 INFO:tasks.workunit.client.0.smithi120.stdout:started 0x7ff520005d20 2024-09-18T13:03:12.321 INFO:tasks.workunit.client.0.smithi120.stdout:started 0x7ff538005d20 2024-09-18T13:03:12.321 INFO:tasks.workunit.client.0.smithi120.stdout: started 2 aios 2024-09-18T13:03:12.321 INFO:tasks.workunit.client.0.smithi120.stdout:waiting 0x7ff520005d20 2024-09-18T13:03:12.321 INFO:tasks.workunit.client.0.smithi120.stdout:waiting 0x7ff538005d20 2024-09-18T13:03:12.325 INFO:tasks.workunit.client.0.smithi120.stdout:done. 2024-09-18T13:03:13.405 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (4931 ms) 2024-09-18T13:03:13.405 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscPool (4931 ms total) 2024-09-18T13:03:13.406 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:03:13.406 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosMisc 2024-09-18T13:03:15.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-18T13:03:15.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-18T13:03:15.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-18T13:03:15.722 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.Exec (309 ms) 2024-09-18T13:03:15.723 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-18T13:03:15.777 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.WriteSame (54 ms) 2024-09-18T13:03:15.777 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-18T13:03:15.798 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.CmpExt (22 ms) 2024-09-18T13:03:15.798 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-18T13:03:20.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.Applications (4528 ms) 2024-09-18T13:03:20.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-18T13:03:20.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-18T13:03:20.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-18T13:03:20.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-18T13:03:20.327 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-18T13:03:46.591 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMisc.ShutdownRace (26265 ms) 2024-09-18T13:03:47.341 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 8 tests from LibRadosMisc (31178 ms total) 2024-09-18T13:03:47.341 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:03:47.341 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:03:47.341 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 12 tests from 4 test suites ran. (43938 ms total) 2024-09-18T13:03:47.341 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 12 tests. 2024-09-18T13:03:47.356 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:03:47.356 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:03:47.356 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_misc_pp 2024-09-18T13:03:47.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:47.402+0000 7f469786b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:03:47.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:47.402+0000 7f469786b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:03:47.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:03:47.403+0000 7f469786b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:03:47.404 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-18T13:03:47.404 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:03:47.404 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-18T13:03:47.404 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-18T13:03:47.405 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-18T13:03:47.405 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-18T13:03:47.405 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:03:47.405 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-18T13:03:47.405 INFO:tasks.workunit.client.0.smithi120.stdout:seed 93317 2024-09-18T13:03:49.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-18T13:03:49.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2024-09-18T13:03:49.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-18T13:03:49.743 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.LongNamePP (393 ms) 2024-09-18T13:03:49.743 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-18T13:03:49.743 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-18T13:03:49.744 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:03:49.744 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-18T13:03:49.744 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-18T13:03:49.807 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (64 ms) 2024-09-18T13:03:49.808 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-18T13:03:49.861 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (53 ms) 2024-09-18T13:03:49.861 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-18T13:03:49.877 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.ExecPP (16 ms) 2024-09-18T13:03:49.877 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-18T13:03:49.893 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (16 ms) 2024-09-18T13:03:49.893 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-18T13:03:49.922 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.Operate1PP (29 ms) 2024-09-18T13:03:49.923 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-18T13:03:49.939 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.Operate2PP (18 ms) 2024-09-18T13:03:49.940 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-18T13:03:49.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (52 ms) 2024-09-18T13:03:49.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-18T13:03:50.011 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (19 ms) 2024-09-18T13:03:50.011 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-18T13:03:50.038 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (27 ms) 2024-09-18T13:03:50.038 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-18T13:03:50.093 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (55 ms) 2024-09-18T13:03:50.094 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-18T13:03:50.106 INFO:tasks.workunit.client.0.smithi120.stdout:osd_max_attr_size = 0 2024-09-18T13:03:50.106 INFO:tasks.workunit.client.0.smithi120.stdout:osd_max_attr_size == 0; skipping test 2024-09-18T13:04:09.317 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (19223 ms) 2024-09-18T13:04:09.317 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-18T13:04:09.317 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-18T13:04:09.317 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:09.317 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-18T13:04:09.318 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-18T13:04:09.318 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-18T13:04:09.318 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:09.318 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-18T13:04:09.318 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-18T13:04:09.356 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (40 ms) 2024-09-18T13:04:09.356 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-18T13:04:09.378 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (22 ms) 2024-09-18T13:04:09.378 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-18T13:04:13.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.Applications (3970 ms) 2024-09-18T13:04:13.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-18T13:04:13.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-18T13:04:13.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-18T13:04:13.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-18T13:04:13.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-18T13:04:13.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-18T13:04:14.348 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 22 tests from LibRadosMiscPP (23999 ms total) 2024-09-18T13:04:14.348 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:14.349 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-18T13:04:16.359 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-18T13:04:16.661 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosChecksum/0.Subset (302 ms) 2024-09-18T13:04:16.662 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-18T13:04:16.689 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosChecksum/0.Chunked (28 ms) 2024-09-18T13:04:17.364 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosChecksum/0 (330 ms total) 2024-09-18T13:04:17.364 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:17.364 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-18T13:04:19.376 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-18T13:04:19.644 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosChecksum/1.Subset (267 ms) 2024-09-18T13:04:19.644 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-18T13:04:19.733 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosChecksum/1.Chunked (90 ms) 2024-09-18T13:04:20.335 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosChecksum/1 (357 ms total) 2024-09-18T13:04:20.335 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:20.335 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-18T13:04:22.384 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-18T13:04:22.608 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosChecksum/2.Subset (224 ms) 2024-09-18T13:04:22.608 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-18T13:04:22.697 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosChecksum/2.Chunked (88 ms) 2024-09-18T13:04:23.397 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosChecksum/2 (313 ms total) 2024-09-18T13:04:23.397 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:23.397 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-18T13:04:23.397 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:04:23.398 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:23.398 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-18T13:04:23.398 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:04:23.398 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:23.398 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:04:23.398 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:23.399 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-18T13:04:23.399 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:04:23.399 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:23.399 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-18T13:04:23.399 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:23.399 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:04:23.400 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 31 tests from 7 test suites ran. (35992 ms total) 2024-09-18T13:04:23.400 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 26 tests. 2024-09-18T13:04:23.400 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-18T13:04:23.400 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-18T13:04:23.400 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-18T13:04:23.400 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-18T13:04:23.401 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-18T13:04:23.401 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-18T13:04:23.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:04:23.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:04:23.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_tier_pp 2024-09-18T13:04:23.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:04:23.439+0000 7fc170b319c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:04:23.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:04:23.439+0000 7fc170b319c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:04:23.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:04:23.439+0000 7fc170b319c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:04:23.442 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-18T13:04:23.442 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:04:23.442 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-18T13:04:23.442 INFO:tasks.workunit.client.0.smithi120.stdout:seed 93389 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-18T13:04:25.410 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-18T13:04:25.411 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-18T13:04:25.411 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:25.411 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-18T13:04:26.415 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-18T13:04:26.415 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:26.415 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-18T13:04:28.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-18T13:04:28.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-18T13:04:28.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-18T13:04:28.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-18T13:04:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-18T13:04:28.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-18T13:04:28.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.449 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.450 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.451 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-18T13:04:28.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-18T13:04:28.454 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-18T13:04:28.455 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-18T13:04:28.455 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.455 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-18T13:04:28.455 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:28.455 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-18T13:04:29.427 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (0 ms total) 2024-09-18T13:04:29.427 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:29.427 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-18T13:04:29.427 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:04:29.427 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.427 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-18T13:04:29.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-18T13:04:29.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-18T13:04:29.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.435 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.436 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-18T13:04:29.438 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.439 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-18T13:04:29.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 77 tests from 4 test suites ran. (5986 ms total) 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 0 tests. 2024-09-18T13:04:29.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-18T13:04:29.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-18T13:04:29.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-18T13:04:29.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-18T13:04:29.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-18T13:04:29.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-18T13:04:29.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-18T13:04:29.448 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:04:29.448 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:04:29.448 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_pool 2024-09-18T13:04:29.453 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:04:29.453 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-18T13:04:29.453 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:04:29.453 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from LibRadosPools 2024-09-18T13:04:29.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-18T13:04:32.339 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolList (2886 ms) 2024-09-18T13:04:32.339 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-18T13:04:35.355 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolLookup (3016 ms) 2024-09-18T13:04:35.355 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-18T13:04:38.366 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolLookup2 (3011 ms) 2024-09-18T13:04:38.366 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-18T13:04:41.339 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (2973 ms) 2024-09-18T13:04:41.340 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-18T13:04:44.391 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3051 ms) 2024-09-18T13:04:44.391 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-18T13:04:49.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolDelete (5029 ms) 2024-09-18T13:04:49.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-18T13:04:54.346 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4927 ms) 2024-09-18T13:04:54.347 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5032 ms) 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/pool.cc:139: Skipped 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from LibRadosPools (29925 ms total) 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 9 tests from 1 test suite ran. (29925 ms total) 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 8 tests. 2024-09-18T13:04:59.379 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-18T13:04:59.380 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-18T13:04:59.381 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:04:59.381 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:04:59.381 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_snapshots 2024-09-18T13:04:59.405 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:04:59.405 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-18T13:04:59.405 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:04:59.405 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-18T13:05:01.346 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-18T13:05:03.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshots.SnapList (2037 ms) 2024-09-18T13:05:03.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-18T13:05:05.385 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2002 ms) 2024-09-18T13:05:05.385 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-18T13:05:07.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshots.Rollback (2018 ms) 2024-09-18T13:05:07.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-18T13:05:09.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2009 ms) 2024-09-18T13:05:10.344 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosSnapshots (8066 ms total) 2024-09-18T13:05:10.344 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:05:10.344 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-18T13:05:12.345 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-18T13:05:16.421 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4076 ms) 2024-09-18T13:05:16.421 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-18T13:05:20.420 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (3999 ms) 2024-09-18T13:05:20.420 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-18T13:05:25.472 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5048 ms) 2024-09-18T13:05:26.428 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13123 ms total) 2024-09-18T13:05:26.428 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:05:26.428 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:168: Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (1 ms) 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.429 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-18T13:05:26.430 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:176: Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosSnapshotsEC (1 ms total) 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:168: Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-18T13:05:26.431 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:176: Skipped 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 13 tests from 4 test suites ran. (27022 ms total) 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 7 tests. 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-18T13:05:26.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-18T13:05:26.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-18T13:05:26.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-18T13:05:26.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-18T13:05:26.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-18T13:05:26.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-18T13:05:26.433 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:05:26.433 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:05:26.434 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-18T13:05:26.456 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:05:26.456 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-18T13:05:26.456 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:05:26.456 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-18T13:05:26.456 INFO:tasks.workunit.client.0.smithi120.stdout:seed 93646 2024-09-18T13:05:28.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-18T13:05:30.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (1911 ms) 2024-09-18T13:05:30.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-18T13:05:32.356 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2008 ms) 2024-09-18T13:05:32.356 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-18T13:05:34.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2013 ms) 2024-09-18T13:05:34.369 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-18T13:05:36.376 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2007 ms) 2024-09-18T13:05:36.377 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-18T13:05:40.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3973 ms) 2024-09-18T13:05:41.354 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from LibRadosSnapshotsPP (11912 ms total) 2024-09-18T13:05:41.354 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:05:41.354 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-18T13:05:43.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-18T13:05:47.477 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4074 ms) 2024-09-18T13:05:47.477 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-18T13:05:51.355 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3877 ms) 2024-09-18T13:05:51.355 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-18T13:05:57.386 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6032 ms) 2024-09-18T13:05:57.386 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-18T13:06:01.361 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3975 ms) 2024-09-18T13:06:01.361 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-18T13:06:03.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2078 ms) 2024-09-18T13:06:03.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-18T13:06:03.440 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-18T13:06:03.440 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:03.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-18T13:06:03.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-18T13:06:05.381 INFO:tasks.workunit.client.0.smithi120.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi120-93646-7 2024-09-18T13:06:06.382 INFO:tasks.workunit.client.0.smithi120.stdout:waiting for snaps to purge 2024-09-18T13:06:21.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17963 ms) 2024-09-18T13:06:22.361 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37999 ms total) 2024-09-18T13:06:22.362 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:22.362 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-18T13:06:22.362 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-18T13:06:22.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (9 ms) 2024-09-18T13:06:22.370 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-18T13:06:27.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5067 ms) 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5076 ms total) 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:27.442 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-18T13:06:27.443 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.444 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.445 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:27.446 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 21 tests from 5 test suites ran. (60981 ms total) 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 13 tests. 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-18T13:06:27.447 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-18T13:06:27.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-18T13:06:27.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-18T13:06:27.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-18T13:06:27.448 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:06:27.448 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:06:27.448 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_stat 2024-09-18T13:06:27.469 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:06:27.469 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-18T13:06:27.469 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:06:27.469 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from LibRadosStat 2024-09-18T13:06:29.399 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStat.Stat 2024-09-18T13:06:29.638 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStat.Stat (239 ms) 2024-09-18T13:06:29.639 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-18T13:06:29.681 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStat.Stat2 (43 ms) 2024-09-18T13:06:29.681 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-18T13:06:29.740 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStat.StatNS (58 ms) 2024-09-18T13:06:29.740 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-18T13:06:29.740 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStat.ClusterStat (1 ms) 2024-09-18T13:06:29.740 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-18T13:06:29.753 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStat.PoolStat (13 ms) 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from LibRadosStat (354 ms total) 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:168: Skipped 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:06:30.411 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:06:30.412 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:176: Skipped 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:30.413 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 9 tests from 2 test suites ran. (2940 ms total) 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 5 tests. 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-18T13:06:30.414 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:06:30.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:06:30.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_stat_pp 2024-09-18T13:06:30.433 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:06:30.433 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-18T13:06:30.433 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:06:30.433 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-18T13:06:30.433 INFO:tasks.workunit.client.0.smithi120.stdout:seed 93782 2024-09-18T13:06:32.417 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-18T13:06:32.664 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStatPP.StatPP (247 ms) 2024-09-18T13:06:32.664 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-18T13:06:32.715 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (51 ms) 2024-09-18T13:06:32.716 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-18T13:06:32.716 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-18T13:06:32.716 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-18T13:06:32.729 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStatPP.PoolStatPP (14 ms) 2024-09-18T13:06:32.729 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-18T13:06:32.789 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosStatPP.StatPPNS (59 ms) 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from LibRadosStatPP (371 ms total) 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:33.432 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 9 tests from 2 test suites ran. (2999 ms total) 2024-09-18T13:06:33.434 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 5 tests. 2024-09-18T13:06:33.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-18T13:06:33.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-18T13:06:33.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-18T13:06:33.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-18T13:06:33.435 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-18T13:06:33.435 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:06:33.435 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:06:33.436 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_watch_notify 2024-09-18T13:06:33.454 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:06:33.454 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-18T13:06:33.454 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:06:33.454 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-18T13:06:35.360 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-18T13:06:35.734 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify_test_cb 2024-09-18T13:06:35.762 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (402 ms) 2024-09-18T13:06:35.762 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-18T13:06:35.797 INFO:tasks.workunit.client.0.smithi120.stdout:waiting up to 300 for disconnect notification ... 2024-09-18T13:06:38.512 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_errcb cookie 24239024 err -107 2024-09-18T13:06:38.805 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3043 ms) 2024-09-18T13:06:38.805 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-18T13:06:38.848 INFO:tasks.workunit.client.0.smithi120.stdout:waiting up to 300 for disconnect notification ... 2024-09-18T13:06:43.512 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_errcb cookie 24239024 err -107 2024-09-18T13:06:43.855 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5050 ms) 2024-09-18T13:06:43.856 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-18T13:06:43.891 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787584 cookie 24244016 2024-09-18T13:06:43.910 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (56 ms) 2024-09-18T13:06:43.911 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-18T13:06:43.940 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787585 cookie 24244016 2024-09-18T13:06:43.961 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (50 ms) 2024-09-18T13:06:43.961 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-18T13:06:43.989 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787586 cookie 24244016 2024-09-18T13:06:44.008 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.AioNotify (46 ms) 2024-09-18T13:06:44.008 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-18T13:06:44.047 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787587 cookie 24244016 2024-09-18T13:06:44.047 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787587 cookie 24271520 2024-09-18T13:06:44.076 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (69 ms) 2024-09-18T13:06:44.076 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-18T13:06:44.103 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787584 cookie 24244016 2024-09-18T13:06:47.104 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787585 cookie 24244016 2024-09-18T13:06:47.130 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3054 ms) 2024-09-18T13:06:47.130 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-18T13:06:47.161 INFO:tasks.workunit.client.0.smithi120.stdout:waiting up to 1024 for osd to time us out ... 2024-09-18T13:06:51.172 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_errcb cookie 24244016 err -107 2024-09-18T13:06:52.190 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_cb from 15538 notify_id 1735166787587 cookie 24244016 2024-09-18T13:06:52.208 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5078 ms) 2024-09-18T13:06:52.208 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-18T13:06:52.248 INFO:tasks.workunit.client.0.smithi120.stdout:waiting up to 30 for disconnect notification ... 2024-09-18T13:06:53.514 INFO:tasks.workunit.client.0.smithi120.stdout:watch_notify2_test_errcb cookie 24244016 err -107 2024-09-18T13:06:54.259 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2051 ms) 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from LibRadosWatchNotify (18899 ms total) 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:168: Skipped 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:182: Skipped 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.381 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:196: Skipped 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/TestCase.cc:176: Skipped 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 11 tests from 2 test suites ran. (20926 ms total) 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 10 tests. 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-18T13:06:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-18T13:06:54.383 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:06:54.383 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:06:54.383 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-18T13:06:54.405 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:06:54.405 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-18T13:06:54.405 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:06:54.405 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-18T13:06:54.405 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-18T13:06:54.405 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.405 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4931-g090e6509/rpm/el9/BUILD/ceph-19.3.0-4931-g090e6509/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-18T13:06:54.406 INFO:tasks.workunit.client.0.smithi120.stdout:Not supported by crimson yet. Skipped 2024-09-18T13:06:54.407 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-18T13:06:54.407 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:06:54.407 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-18T13:06:56.368 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-18T13:06:56.697 INFO:tasks.workunit.client.0.smithi120.stdout:notify 2024-09-18T13:06:56.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (344 ms) 2024-09-18T13:06:56.712 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-18T13:06:56.750 INFO:tasks.workunit.client.0.smithi120.stdout:notify 2024-09-18T13:06:56.765 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (53 ms) 2024-09-18T13:06:56.765 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-18T13:06:56.804 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (39 ms) 2024-09-18T13:06:56.804 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-18T13:06:56.839 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (35 ms) 2024-09-18T13:06:56.839 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-18T13:06:56.871 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38737712 notify_id 1748051689472 notifier_gid 15541 2024-09-18T13:06:56.885 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (46 ms) 2024-09-18T13:06:56.885 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-18T13:06:56.916 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38737712 notify_id 1748051689473 notifier_gid 15541 2024-09-18T13:06:56.931 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (46 ms) 2024-09-18T13:06:56.931 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-18T13:06:56.966 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38737712 notify_id 1748051689477 notifier_gid 15541 2024-09-18T13:06:56.981 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (50 ms) 2024-09-18T13:06:56.981 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-18T13:06:57.013 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38737712 notify_id 1748051689474 notifier_gid 15541 2024-09-18T13:06:57.028 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (47 ms) 2024-09-18T13:06:57.029 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-18T13:06:57.063 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38737712 notify_id 1748051689478 notifier_gid 15541 2024-09-18T13:06:57.079 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (51 ms) 2024-09-18T13:06:57.080 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-18T13:06:57.115 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38743952 notify_id 1748051689476 notifier_gid 15541 2024-09-18T13:06:57.129 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (50 ms) 2024-09-18T13:06:57.130 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-18T13:06:57.158 INFO:tasks.workunit.client.0.smithi120.stdout: trying... 2024-09-18T13:06:57.161 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38743952 notify_id 1748051689477 notifier_gid 15541 2024-09-18T13:06:58.160 INFO:tasks.workunit.client.0.smithi120.stdout: timed out 2024-09-18T13:06:58.172 INFO:tasks.workunit.client.0.smithi120.stdout: flushing 2024-09-18T13:07:00.162 INFO:tasks.workunit.client.0.smithi120.stdout: flushed 2024-09-18T13:07:00.162 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3033 ms) 2024-09-18T13:07:00.162 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-18T13:07:00.198 INFO:tasks.workunit.client.0.smithi120.stdout: trying... 2024-09-18T13:07:00.203 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38743952 notify_id 1748051689475 notifier_gid 15541 2024-09-18T13:07:01.203 INFO:tasks.workunit.client.0.smithi120.stdout: timed out 2024-09-18T13:07:01.219 INFO:tasks.workunit.client.0.smithi120.stdout: flushing 2024-09-18T13:07:03.203 INFO:tasks.workunit.client.0.smithi120.stdout: flushed 2024-09-18T13:07:03.203 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3041 ms) 2024-09-18T13:07:03.203 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-18T13:07:03.238 INFO:tasks.workunit.client.0.smithi120.stdout:List watches 2024-09-18T13:07:03.238 INFO:tasks.workunit.client.0.smithi120.stdout:notify2 2024-09-18T13:07:03.242 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38757632 notify_id 1748051689478 notifier_gid 15541 2024-09-18T13:07:06.248 INFO:tasks.workunit.client.0.smithi120.stdout:notify2 done 2024-09-18T13:07:06.248 INFO:tasks.workunit.client.0.smithi120.stdout:watch_check 2024-09-18T13:07:06.248 INFO:tasks.workunit.client.0.smithi120.stdout:unwatch2 2024-09-18T13:07:06.263 INFO:tasks.workunit.client.0.smithi120.stdout: flushing 2024-09-18T13:07:06.263 INFO:tasks.workunit.client.0.smithi120.stdout:done 2024-09-18T13:07:06.263 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3060 ms) 2024-09-18T13:07:06.263 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-18T13:07:06.299 INFO:tasks.workunit.client.0.smithi120.stdout:List watches 2024-09-18T13:07:06.299 INFO:tasks.workunit.client.0.smithi120.stdout:notify2 2024-09-18T13:07:06.303 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38743952 notify_id 1752346656770 notifier_gid 15541 2024-09-18T13:07:09.308 INFO:tasks.workunit.client.0.smithi120.stdout:notify2 done 2024-09-18T13:07:09.309 INFO:tasks.workunit.client.0.smithi120.stdout:watch_check 2024-09-18T13:07:09.309 INFO:tasks.workunit.client.0.smithi120.stdout:unwatch2 2024-09-18T13:07:09.322 INFO:tasks.workunit.client.0.smithi120.stdout: flushing 2024-09-18T13:07:09.322 INFO:tasks.workunit.client.0.smithi120.stdout:done 2024-09-18T13:07:09.323 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3059 ms) 2024-09-18T13:07:09.764 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12954 ms total) 2024-09-18T13:07:09.764 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:09.764 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:07:09.764 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 16 tests from 2 test suites ran. (15359 ms total) 2024-09-18T13:07:09.764 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 14 tests. 2024-09-18T13:07:09.764 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-18T13:07:09.764 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-18T13:07:09.765 INFO:tasks.workunit.client.0.smithi120.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-18T13:07:09.766 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:07:09.766 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:07:09.766 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_cmd 2024-09-18T13:07:09.787 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:07:09.787 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-18T13:07:09.787 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:07:09.787 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosCmd 2024-09-18T13:07:09.787 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-18T13:07:09.863 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCmd.MonDescribe (76 ms) 2024-09-18T13:07:09.863 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-18T13:07:09.935 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCmd.OSDCmd (72 ms) 2024-09-18T13:07:09.936 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-18T13:07:12.381 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCmd.PGCmd (2444 ms) 2024-09-18T13:07:12.381 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-18T13:07:12.422 INFO:tasks.workunit.client.0.smithi120.stdout:got: 2024-09-18T13:07:11.364912+0000 mon.a [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-18T13:07:12.422 INFO:tasks.workunit.client.0.smithi120.stdout:got: 2024-09-18T13:07:11.370875+0000 mon.a [INF] from='client.? 172.21.15.120:0/4285690155' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi120-93839-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-18T13:07:13.377 INFO:tasks.workunit.client.0.smithi120.stdout:got: 2024-09-18T13:07:12.419506+0000 client.admin [INF] onexx 2024-09-18T13:07:13.377 INFO:tasks.workunit.client.0.smithi120.stdout:got: 2024-09-18T13:07:12.420098+0000 mon.a [INF] from='client.? 172.21.15.120:0/4174618226' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-18T13:07:17.383 INFO:tasks.workunit.client.0.smithi120.stdout:got: 2024-09-18T13:07:15.381532+0000 mon.a [INF] from='client.? 172.21.15.120:0/4174618226' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-18T13:07:17.435 INFO:tasks.workunit.client.0.smithi120.stdout:got: 2024-09-18T13:07:17.382382+0000 client.admin [INF] threexx 2024-09-18T13:07:17.435 INFO:tasks.workunit.client.0.smithi120.stdout:got: 2024-09-18T13:07:17.382953+0000 mon.a [INF] from='client.? 172.21.15.120:0/4174618226' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-18T13:07:21.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCmd.WatchLog (9062 ms) 2024-09-18T13:07:21.442 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosCmd (11654 ms total) 2024-09-18T13:07:21.442 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:21.442 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:07:21.442 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 4 tests from 1 test suite ran. (11654 ms total) 2024-09-18T13:07:21.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 4 tests. 2024-09-18T13:07:21.444 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:07:21.444 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:07:21.444 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-18T13:07:21.467 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:07:21.467 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-18T13:07:21.467 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:07:21.467 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosCmd 2024-09-18T13:07:21.467 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-18T13:07:21.500 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCmd.MonDescribePP (34 ms) 2024-09-18T13:07:21.500 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-18T13:07:21.537 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCmd.OSDCmdPP (33 ms) 2024-09-18T13:07:21.537 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-18T13:07:24.459 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCmd.PGCmdPP (2926 ms) 2024-09-18T13:07:24.460 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from LibRadosCmd (2993 ms total) 2024-09-18T13:07:24.460 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:24.460 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:07:24.460 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 3 tests from 1 test suite ran. (2993 ms total) 2024-09-18T13:07:24.460 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 3 tests. 2024-09-18T13:07:24.461 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:07:24.461 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:07:24.461 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_service 2024-09-18T13:07:24.503 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-18T13:07:24.503 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:07:24.503 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosService 2024-09-18T13:07:24.503 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-18T13:07:24.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:07:24.501+0000 7f44b602d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:07:24.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:07:24.501+0000 7f44b602d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:07:24.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:07:24.502+0000 7f44b602d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:07:29.556 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosService.RegisterEarly (5053 ms) 2024-09-18T13:07:29.557 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-18T13:07:29.584 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosService.RegisterLate (28 ms) 2024-09-18T13:07:29.584 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: cluster: 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: id: 663d1a24-c7eb-48da-8c03-7f80c4504c0c 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: health: HEALTH_WARN 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: 1 pool(s) do not have an application enabled 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: services: 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: mon: 1 daemons, quorum a (age 9m) 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: mgr: x(active, since 9m) 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 9m) 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: laundry: 1 daemon active (1 hosts) 2024-09-18T13:07:29.737 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:29.738 INFO:tasks.workunit.client.0.smithi120.stdout: data: 2024-09-18T13:07:29.738 INFO:tasks.workunit.client.0.smithi120.stdout: pools: 3 pools, 41 pgs 2024-09-18T13:07:29.738 INFO:tasks.workunit.client.0.smithi120.stdout: objects: 5 objects, 577 KiB 2024-09-18T13:07:29.738 INFO:tasks.workunit.client.0.smithi120.stdout: usage: 221 MiB used, 360 GiB / 360 GiB avail 2024-09-18T13:07:29.738 INFO:tasks.workunit.client.0.smithi120.stdout: pgs: 41 active+clean 2024-09-18T13:07:29.738 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:29.738 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:31.762 INFO:tasks.workunit.client.0.smithi120.stdout: cluster: 2024-09-18T13:07:31.762 INFO:tasks.workunit.client.0.smithi120.stdout: id: 663d1a24-c7eb-48da-8c03-7f80c4504c0c 2024-09-18T13:07:31.762 INFO:tasks.workunit.client.0.smithi120.stdout: health: HEALTH_WARN 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: 1 pool(s) do not have an application enabled 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: services: 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: mgr: x(active, since 9m) 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 9m) 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: data: 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: pools: 3 pools, 41 pgs 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: objects: 5 objects, 577 KiB 2024-09-18T13:07:31.763 INFO:tasks.workunit.client.0.smithi120.stdout: usage: 221 MiB used, 360 GiB / 360 GiB avail 2024-09-18T13:07:31.764 INFO:tasks.workunit.client.0.smithi120.stdout: pgs: 41 active+clean 2024-09-18T13:07:31.764 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:31.764 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:31.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosService.StatusFormat (2200 ms) 2024-09-18T13:07:31.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosService.Status 2024-09-18T13:07:51.812 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosService.Status (20028 ms) 2024-09-18T13:07:51.812 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosService (27309 ms total) 2024-09-18T13:07:51.812 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:07:51.812 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:07:51.812 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 4 tests from 1 test suite ran. (27309 ms total) 2024-09-18T13:07:51.813 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 4 tests. 2024-09-18T13:07:51.817 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:07:51.818 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:07:51.818 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_service_pp 2024-09-18T13:07:51.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:07:51.851+0000 7f7f7a8fa840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:07:51.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:07:51.852+0000 7f7f7a8fa840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:07:51.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:07:51.852+0000 7f7f7a8fa840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:07:51.853 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-18T13:07:51.853 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:07:51.854 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-18T13:07:51.854 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-18T13:07:56.880 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5027 ms) 2024-09-18T13:07:56.880 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-18T13:07:56.924 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosServicePP.RegisterLate (44 ms) 2024-09-18T13:07:56.925 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-18T13:08:16.953 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosServicePP.Status (20028 ms) 2024-09-18T13:08:16.954 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-18T13:08:16.954 INFO:tasks.workunit.client.0.smithi120.stdout:attempt 0 of 20 2024-09-18T13:08:22.008 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosServicePP.Close (5055 ms) 2024-09-18T13:08:22.008 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from LibRadosServicePP (30154 ms total) 2024-09-18T13:08:22.008 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:08:22.008 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:08:22.008 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 4 tests from 1 test suite ran. (30154 ms total) 2024-09-18T13:08:22.008 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 4 tests. 2024-09-18T13:08:22.011 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:08:22.011 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:08:22.011 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-18T13:08:22.033 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-18T13:08:24.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCWriteOps.assertExists (2370 ms) 2024-09-18T13:08:24.403 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-18T13:08:27.427 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3024 ms) 2024-09-18T13:08:27.427 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-18T13:08:30.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3018 ms) 2024-09-18T13:08:30.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-18T13:08:33.457 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCWriteOps.Write (3012 ms) 2024-09-18T13:08:33.457 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-18T13:08:36.466 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCWriteOps.Exec (3009 ms) 2024-09-18T13:08:36.467 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-18T13:08:39.490 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3024 ms) 2024-09-18T13:08:39.490 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-18T13:08:49.787 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRadosCWriteOps.CmpExt (10296 ms) 2024-09-18T13:08:49.787 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from LibRadosCWriteOps (27753 ms total) 2024-09-18T13:08:49.787 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:08:49.787 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:08:49.787 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 8 tests from 2 test suites ran. (27753 ms total) 2024-09-18T13:08:49.787 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 8 tests. 2024-09-18T13:08:49.789 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:08:49.789 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:08:49.789 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-18T13:08:49.809 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:08:49.809 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-18T13:08:49.809 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:08:49.809 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 17 tests from CReadOpsTest 2024-09-18T13:08:51.394 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-18T13:08:51.394 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-18T13:08:51.394 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-18T13:08:51.685 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.SetOpFlags (291 ms) 2024-09-18T13:08:51.685 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-18T13:08:51.722 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.AssertExists (37 ms) 2024-09-18T13:08:51.722 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-18T13:08:51.774 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.AssertVersion (52 ms) 2024-09-18T13:08:51.774 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-18T13:08:51.959 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.CmpXattr (185 ms) 2024-09-18T13:08:51.959 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.Read 2024-09-18T13:08:52.010 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.Read (51 ms) 2024-09-18T13:08:52.010 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-18T13:08:52.056 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.Checksum (46 ms) 2024-09-18T13:08:52.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-18T13:08:52.088 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.RWOrderedRead (32 ms) 2024-09-18T13:08:52.088 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-18T13:08:52.131 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.ShortRead (42 ms) 2024-09-18T13:08:52.131 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-18T13:08:52.158 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.Exec (28 ms) 2024-09-18T13:08:52.158 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-18T13:08:52.197 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.ExecUserBuf (39 ms) 2024-09-18T13:08:52.197 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-18T13:08:52.234 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.Stat (37 ms) 2024-09-18T13:08:52.234 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-18T13:08:52.274 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.Stat2 (39 ms) 2024-09-18T13:08:52.274 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-18T13:08:52.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.Omap (109 ms) 2024-09-18T13:08:52.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-18T13:08:52.501 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.OmapNuls (119 ms) 2024-09-18T13:08:52.501 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-18T13:08:52.580 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.GetXattrs (79 ms) 2024-09-18T13:08:52.580 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-18T13:08:52.617 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CReadOpsTest.CmpExt (37 ms) 2024-09-18T13:08:53.407 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 17 tests from CReadOpsTest (1223 ms total) 2024-09-18T13:08:53.408 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:08:53.408 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:08:53.408 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 17 tests from 1 test suite ran. (3598 ms total) 2024-09-18T13:08:53.408 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 17 tests. 2024-09-18T13:08:53.410 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:08:53.410 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:08:53.410 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_list_parallel 2024-09-18T13:08:56.329 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94521]: starting. 2024-09-18T13:08:56.329 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94521]: creating pool ceph_test_rados_list_parallel.smithi120-94520 2024-09-18T13:08:56.329 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94521]: created object 0... 2024-09-18T13:08:56.329 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94521]: created object 25... 2024-09-18T13:08:56.329 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94521]: created object 49... 2024-09-18T13:08:56.329 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94521]: finishing. 2024-09-18T13:08:56.330 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94521]: shutting down. 2024-09-18T13:08:56.473 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94522]: starting. 2024-09-18T13:08:56.473 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94522]: listing objects. 2024-09-18T13:08:56.473 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94522]: listed object 0... 2024-09-18T13:08:56.473 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94522]: listed object 25... 2024-09-18T13:08:56.473 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94522]: saw 50 objects 2024-09-18T13:08:56.473 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94522]: shutting down. 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94557]: starting. 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94557]: creating pool ceph_test_rados_list_parallel.smithi120-94520 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94557]: created object 0... 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94557]: created object 25... 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94557]: created object 49... 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94557]: finishing. 2024-09-18T13:08:57.125 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94557]: shutting down. 2024-09-18T13:08:57.448 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:57.448 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94558]: starting. 2024-09-18T13:08:57.448 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94558]: listing objects. 2024-09-18T13:08:57.448 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94558]: listed object 0... 2024-09-18T13:08:57.448 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94558]: listed object 25... 2024-09-18T13:08:57.448 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94558]: saw 45 objects 2024-09-18T13:08:57.448 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94558]: shutting down. 2024-09-18T13:08:57.735 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:57.735 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94559]: starting. 2024-09-18T13:08:57.735 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94559]: removed 25 objects... 2024-09-18T13:08:57.735 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94559]: removed half of the objects 2024-09-18T13:08:57.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94559]: removed 50 objects... 2024-09-18T13:08:57.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94559]: removed 50 objects 2024-09-18T13:08:57.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94559]: shutting down. 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:process_6_[94608]: starting. 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:process_6_[94608]: creating pool ceph_test_rados_list_parallel.smithi120-94520 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:process_6_[94608]: created object 0... 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:process_6_[94608]: created object 25... 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:process_6_[94608]: created object 49... 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:process_6_[94608]: finishing. 2024-09-18T13:08:58.391 INFO:tasks.workunit.client.0.smithi120.stdout:process_6_[94608]: shutting down. 2024-09-18T13:08:58.736 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:58.736 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:58.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_7_[94609]: starting. 2024-09-18T13:08:58.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_7_[94609]: listing objects. 2024-09-18T13:08:58.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_7_[94609]: listed object 0... 2024-09-18T13:08:58.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_7_[94609]: listed object 25... 2024-09-18T13:08:58.736 INFO:tasks.workunit.client.0.smithi120.stdout:process_7_[94609]: listed object 50... 2024-09-18T13:08:58.737 INFO:tasks.workunit.client.0.smithi120.stdout:process_7_[94609]: saw 56 objects 2024-09-18T13:08:58.737 INFO:tasks.workunit.client.0.smithi120.stdout:process_7_[94609]: shutting down. 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:process_8_[94610]: starting. 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:process_8_[94610]: added 25 objects... 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:process_8_[94610]: added half of the objects 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:process_8_[94610]: added 50 objects... 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:process_8_[94610]: added 50 objects 2024-09-18T13:08:59.067 INFO:tasks.workunit.client.0.smithi120.stdout:process_8_[94610]: shutting down. 2024-09-18T13:08:59.777 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:59.777 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:59.777 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:08:59.778 INFO:tasks.workunit.client.0.smithi120.stdout:process_9_[94659]: starting. 2024-09-18T13:08:59.778 INFO:tasks.workunit.client.0.smithi120.stdout:process_9_[94659]: creating pool ceph_test_rados_list_parallel.smithi120-94520 2024-09-18T13:08:59.778 INFO:tasks.workunit.client.0.smithi120.stdout:process_9_[94659]: created object 0... 2024-09-18T13:08:59.778 INFO:tasks.workunit.client.0.smithi120.stdout:process_9_[94659]: created object 25... 2024-09-18T13:08:59.778 INFO:tasks.workunit.client.0.smithi120.stdout:process_9_[94659]: created object 49... 2024-09-18T13:08:59.778 INFO:tasks.workunit.client.0.smithi120.stdout:process_9_[94659]: finishing. 2024-09-18T13:08:59.778 INFO:tasks.workunit.client.0.smithi120.stdout:process_9_[94659]: shutting down. 2024-09-18T13:09:00.181 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.181 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.181 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: starting. 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: listing objects. 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: listed object 0... 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: listed object 25... 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: listed object 50... 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: listed object 75... 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: saw 99 objects 2024-09-18T13:09:00.182 INFO:tasks.workunit.client.0.smithi120.stdout:process_10_[94660]: shutting down. 2024-09-18T13:09:00.531 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:process_13_[94663]: starting. 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:process_13_[94663]: removed 25 objects... 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:process_13_[94663]: removed half of the objects 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:process_13_[94663]: removed 50 objects... 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:process_13_[94663]: removed 50 objects 2024-09-18T13:09:00.532 INFO:tasks.workunit.client.0.smithi120.stdout:process_13_[94663]: shutting down. 2024-09-18T13:09:00.575 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.575 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.575 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.575 INFO:tasks.workunit.client.0.smithi120.stdout:process_11_[94661]: starting. 2024-09-18T13:09:00.575 INFO:tasks.workunit.client.0.smithi120.stdout:process_11_[94661]: added 25 objects... 2024-09-18T13:09:00.575 INFO:tasks.workunit.client.0.smithi120.stdout:process_11_[94661]: added half of the objects 2024-09-18T13:09:00.576 INFO:tasks.workunit.client.0.smithi120.stdout:process_11_[94661]: added 50 objects... 2024-09-18T13:09:00.576 INFO:tasks.workunit.client.0.smithi120.stdout:process_11_[94661]: added 50 objects 2024-09-18T13:09:00.576 INFO:tasks.workunit.client.0.smithi120.stdout:process_11_[94661]: shutting down. 2024-09-18T13:09:00.627 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:process_12_[94662]: starting. 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:process_12_[94662]: added 25 objects... 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:process_12_[94662]: added half of the objects 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:process_12_[94662]: added 50 objects... 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:process_12_[94662]: added 50 objects 2024-09-18T13:09:00.628 INFO:tasks.workunit.client.0.smithi120.stdout:process_12_[94662]: shutting down. 2024-09-18T13:09:01.288 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.288 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.288 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.288 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.288 INFO:tasks.workunit.client.0.smithi120.stdout:process_14_[94744]: starting. 2024-09-18T13:09:01.288 INFO:tasks.workunit.client.0.smithi120.stdout:process_14_[94744]: creating pool ceph_test_rados_list_parallel.smithi120-94520 2024-09-18T13:09:01.288 INFO:tasks.workunit.client.0.smithi120.stdout:process_14_[94744]: created object 0... 2024-09-18T13:09:01.289 INFO:tasks.workunit.client.0.smithi120.stdout:process_14_[94744]: created object 25... 2024-09-18T13:09:01.289 INFO:tasks.workunit.client.0.smithi120.stdout:process_14_[94744]: created object 49... 2024-09-18T13:09:01.289 INFO:tasks.workunit.client.0.smithi120.stdout:process_14_[94744]: finishing. 2024-09-18T13:09:01.289 INFO:tasks.workunit.client.0.smithi120.stdout:process_14_[94744]: shutting down. 2024-09-18T13:09:01.621 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: starting. 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: listing objects. 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: listed object 0... 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: listed object 25... 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: listed object 50... 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: listed object 75... 2024-09-18T13:09:01.622 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: listed object 100... 2024-09-18T13:09:01.623 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: listed object 125... 2024-09-18T13:09:01.623 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: saw 150 objects 2024-09-18T13:09:01.623 INFO:tasks.workunit.client.0.smithi120.stdout:process_15_[94745]: shutting down. 2024-09-18T13:09:01.937 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:process_16_[94746]: starting. 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:process_16_[94746]: added 25 objects... 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:process_16_[94746]: added half of the objects 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:process_16_[94746]: added 50 objects... 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:process_16_[94746]: added 50 objects 2024-09-18T13:09:01.941 INFO:tasks.workunit.client.0.smithi120.stdout:process_16_[94746]: shutting down. 2024-09-18T13:09:02.396 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:02.397 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:02.397 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:02.397 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:02.397 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:02.397 INFO:tasks.workunit.client.0.smithi120.stdout:******* SUCCESS ********** 2024-09-18T13:09:02.398 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:09:02.398 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:09:02.398 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-18T13:09:05.336 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94812]: starting. 2024-09-18T13:09:05.336 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94812]: creating pool ceph_test_rados_open_pools_parallel.smithi120-94811 2024-09-18T13:09:05.336 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94812]: created object 0... 2024-09-18T13:09:05.337 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94812]: created object 25... 2024-09-18T13:09:05.337 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94812]: created object 49... 2024-09-18T13:09:05.337 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94812]: finishing. 2024-09-18T13:09:05.337 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94812]: shutting down. 2024-09-18T13:09:05.395 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94813]: starting. 2024-09-18T13:09:05.395 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94813]: rados_pool_create. 2024-09-18T13:09:05.395 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94813]: rados_ioctx_create. 2024-09-18T13:09:05.395 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94813]: shutting down. 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94848]: starting. 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94848]: creating pool ceph_test_rados_open_pools_parallel.smithi120-94811 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94848]: created object 0... 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94848]: created object 25... 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94848]: created object 49... 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94848]: finishing. 2024-09-18T13:09:08.323 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94848]: shutting down. 2024-09-18T13:09:08.426 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:08.426 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94849]: starting. 2024-09-18T13:09:08.426 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94849]: rados_pool_create. 2024-09-18T13:09:08.426 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94849]: rados_ioctx_create. 2024-09-18T13:09:08.426 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94849]: shutting down. 2024-09-18T13:09:08.428 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:08.428 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:08.428 INFO:tasks.workunit.client.0.smithi120.stdout:******* SUCCESS ********** 2024-09-18T13:09:08.429 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-18T13:09:08.429 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:09:08.429 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-18T13:09:11.345 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94885]: starting. 2024-09-18T13:09:11.346 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94885]: creating pool ceph_test_rados_delete_pools_parallel.smithi120-94884 2024-09-18T13:09:11.346 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94885]: created object 0... 2024-09-18T13:09:11.346 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94885]: created object 25... 2024-09-18T13:09:11.346 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94885]: created object 49... 2024-09-18T13:09:11.346 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94885]: finishing. 2024-09-18T13:09:11.346 INFO:tasks.workunit.client.0.smithi120.stdout:process_1_[94885]: shutting down. 2024-09-18T13:09:11.441 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94886]: starting. 2024-09-18T13:09:11.441 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94886]: deleting pool ceph_test_rados_delete_pools_parallel.smithi120-94884 2024-09-18T13:09:11.441 INFO:tasks.workunit.client.0.smithi120.stdout:process_2_[94886]: shutting down. 2024-09-18T13:09:14.342 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:14.342 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94922]: starting. 2024-09-18T13:09:14.343 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94922]: creating pool ceph_test_rados_delete_pools_parallel.smithi120-94884 2024-09-18T13:09:14.343 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94922]: created object 0... 2024-09-18T13:09:14.343 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94922]: created object 25... 2024-09-18T13:09:14.343 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94922]: created object 49... 2024-09-18T13:09:14.343 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94922]: finishing. 2024-09-18T13:09:14.343 INFO:tasks.workunit.client.0.smithi120.stdout:process_3_[94922]: shutting down. 2024-09-18T13:09:14.455 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:14.455 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94924]: starting. 2024-09-18T13:09:14.455 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94924]: listing objects. 2024-09-18T13:09:14.455 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94924]: listed object 0... 2024-09-18T13:09:14.456 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94924]: listed object 25... 2024-09-18T13:09:14.456 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94924]: saw 50 objects 2024-09-18T13:09:14.456 INFO:tasks.workunit.client.0.smithi120.stdout:process_5_[94924]: shutting down. 2024-09-18T13:09:15.401 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:15.401 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94923]: starting. 2024-09-18T13:09:15.401 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94923]: deleting pool ceph_test_rados_delete_pools_parallel.smithi120-94884 2024-09-18T13:09:15.401 INFO:tasks.workunit.client.0.smithi120.stdout:process_4_[94923]: shutting down. 2024-09-18T13:09:15.402 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:15.402 INFO:tasks.workunit.client.0.smithi120.stdout:******************************* 2024-09-18T13:09:15.403 INFO:tasks.workunit.client.0.smithi120.stdout:******* SUCCESS ********** 2024-09-18T13:09:15.403 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:09:15.403 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:09:15.403 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:09:15.403 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' cls = ec_io ']' 2024-09-18T13:09:15.404 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' cls = ec_list ']' 2024-09-18T13:09:15.404 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_cls 2024-09-18T13:09:15.427 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:09:15.427 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 1 test from 1 test suite. 2024-09-18T13:09:15.428 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:09:15.428 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from NeoRadosCls 2024-09-18T13:09:15.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-18T13:09:18.475 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosCls.DNE (3048 ms) 2024-09-18T13:09:18.475 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from NeoRadosCls (3048 ms total) 2024-09-18T13:09:18.475 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:09:18.475 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:09:18.475 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 1 test from 1 test suite ran. (3048 ms total) 2024-09-18T13:09:18.476 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 1 test. 2024-09-18T13:09:18.478 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:09:18.478 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:09:18.478 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:09:18.478 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' cmd = ec_io ']' 2024-09-18T13:09:18.478 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' cmd = ec_list ']' 2024-09-18T13:09:18.478 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_cmd 2024-09-18T13:09:18.499 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:09:18.499 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-18T13:09:18.499 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:09:18.499 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-18T13:09:18.499 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-18T13:09:20.489 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosCmd.MonDescribe (1991 ms) 2024-09-18T13:09:20.489 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-18T13:09:22.513 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosCmd.OSDCmd (2024 ms) 2024-09-18T13:09:22.513 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-18T13:09:25.398 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosCmd.PGCmd (2885 ms) 2024-09-18T13:09:25.399 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from NeoRadosCmd (6900 ms total) 2024-09-18T13:09:25.399 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:09:25.399 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:09:25.399 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 3 tests from 1 test suite ran. (6900 ms total) 2024-09-18T13:09:25.399 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 3 tests. 2024-09-18T13:09:25.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:09:25.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:09:25.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:09:25.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' handler_error = ec_io ']' 2024-09-18T13:09:25.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' handler_error = ec_list ']' 2024-09-18T13:09:25.402 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_handler_error 2024-09-18T13:09:25.421 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:09:25.421 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 1 test from 1 test suite. 2024-09-18T13:09:25.422 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:09:25.422 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from neocls_handler_error 2024-09-18T13:09:25.422 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-18T13:09:28.411 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] neocls_handler_error.test_handler_error (2990 ms) 2024-09-18T13:09:28.411 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from neocls_handler_error (2990 ms total) 2024-09-18T13:09:28.412 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:09:28.412 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:09:28.412 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 1 test from 1 test suite ran. (2990 ms total) 2024-09-18T13:09:28.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 1 test. 2024-09-18T13:09:28.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:09:28.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:09:28.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:09:28.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' io = ec_io ']' 2024-09-18T13:09:28.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' io = ec_list ']' 2024-09-18T13:09:28.415 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_io 2024-09-18T13:09:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:09:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-18T13:09:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:09:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from NeoRadosIo 2024-09-18T13:09:28.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-18T13:09:29.416 INFO:tasks.workunit.client.0.smithi120.stderr:Not supported by crimson yet. Skipped 2024-09-18T13:09:30.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.Limits (1981 ms) 2024-09-18T13:09:30.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-18T13:09:33.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.SimpleWrite (3017 ms) 2024-09-18T13:09:33.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-18T13:09:36.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.ReadOp (3012 ms) 2024-09-18T13:09:36.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-18T13:09:39.463 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.SparseRead (3015 ms) 2024-09-18T13:09:39.463 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-18T13:09:42.477 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.RoundTrip (3013 ms) 2024-09-18T13:09:42.477 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-18T13:09:45.405 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (2928 ms) 2024-09-18T13:09:45.405 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-18T13:09:48.422 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3018 ms) 2024-09-18T13:09:48.422 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-18T13:09:51.438 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3015 ms) 2024-09-18T13:09:51.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-18T13:09:54.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3015 ms) 2024-09-18T13:09:54.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-18T13:09:57.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.Trunc (2967 ms) 2024-09-18T13:09:57.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-18T13:10:00.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.Remove (3017 ms) 2024-09-18T13:10:00.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-18T13:10:03.456 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3019 ms) 2024-09-18T13:10:03.456 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-18T13:10:06.466 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.RmXattr (3011 ms) 2024-09-18T13:10:06.466 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-18T13:10:09.483 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosIo.GetXattrs (3016 ms) 2024-09-18T13:10:09.483 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from NeoRadosIo (41044 ms total) 2024-09-18T13:10:09.483 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:10:09.483 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:10:09.483 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 14 tests from 1 test suite ran. (41044 ms total) 2024-09-18T13:10:09.483 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 14 tests. 2024-09-18T13:10:09.488 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:10:09.488 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:10:09.488 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:10:09.488 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' ec_io = ec_io ']' 2024-09-18T13:10:09.489 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo 'Skipping EC with Crimson' 2024-09-18T13:10:09.489 INFO:tasks.workunit.client.0.smithi120.stdout:Skipping EC with Crimson 2024-09-18T13:10:09.489 INFO:tasks.workunit.client.0.smithi120.stderr:+ continue 2024-09-18T13:10:09.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:10:09.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:10:09.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:10:09.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' list = ec_io ']' 2024-09-18T13:10:09.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' list = ec_list ']' 2024-09-18T13:10:09.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_list 2024-09-18T13:10:09.511 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:10:09.511 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-18T13:10:09.511 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:10:09.512 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from NeoradosList 2024-09-18T13:10:09.512 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-18T13:10:12.490 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoradosList.ListObjects (2979 ms) 2024-09-18T13:10:12.491 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-18T13:10:15.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoradosList.ListObjectsNS (2922 ms) 2024-09-18T13:10:15.413 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-18T13:10:24.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoradosList.ListObjectsMany (9018 ms) 2024-09-18T13:10:24.431 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 3 tests from NeoradosList (14919 ms total) 2024-09-18T13:10:24.431 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:10:24.431 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:10:24.431 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 3 tests from 1 test suite ran. (14919 ms total) 2024-09-18T13:10:24.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 3 tests. 2024-09-18T13:10:24.434 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:10:24.434 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:10:24.434 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:10:24.434 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' ec_list = ec_io ']' 2024-09-18T13:10:24.435 INFO:tasks.workunit.client.0.smithi120.stdout:Skipping EC with Crimson 2024-09-18T13:10:24.435 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' ec_list = ec_list ']' 2024-09-18T13:10:24.435 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo 'Skipping EC with Crimson' 2024-09-18T13:10:24.435 INFO:tasks.workunit.client.0.smithi120.stderr:+ continue 2024-09-18T13:10:24.435 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:10:24.435 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:10:24.436 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:10:24.436 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' misc = ec_io ']' 2024-09-18T13:10:24.436 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' misc = ec_list ']' 2024-09-18T13:10:24.436 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_misc 2024-09-18T13:10:24.456 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:10:24.456 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-18T13:10:24.456 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:10:24.456 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-18T13:10:24.456 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-18T13:10:26.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.Version (1963 ms) 2024-09-18T13:10:26.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-18T13:10:28.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2024 ms) 2024-09-18T13:10:28.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-18T13:10:31.466 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.LongName (3023 ms) 2024-09-18T13:10:31.466 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-18T13:10:32.468 INFO:tasks.workunit.client.0.smithi120.stderr:Not supported by crimson yet. Skipped 2024-09-18T13:10:33.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.LongLocator (2004 ms) 2024-09-18T13:10:33.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-18T13:10:36.491 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.LongNamespace (3021 ms) 2024-09-18T13:10:36.491 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-18T13:10:39.503 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.LongAttrName (3012 ms) 2024-09-18T13:10:39.503 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-18T13:10:42.512 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.Exec (3009 ms) 2024-09-18T13:10:42.512 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-18T13:10:45.417 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.Operate1 (2905 ms) 2024-09-18T13:10:45.418 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-18T13:10:48.430 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.Operate2 (3013 ms) 2024-09-18T13:10:48.431 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-18T13:10:51.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.BigObject (3019 ms) 2024-09-18T13:10:51.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-18T13:10:53.455 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.BigAttr (2006 ms) 2024-09-18T13:10:53.455 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-18T13:10:54.461 INFO:tasks.workunit.client.0.smithi120.stderr:Not supported by crimson yet. Skipped 2024-09-18T13:10:55.421 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosMisc.WriteSame (1965 ms) 2024-09-18T13:10:55.421 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 12 tests from NeoRadosMisc (30964 ms total) 2024-09-18T13:10:55.421 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:10:55.421 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:10:55.421 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 12 tests from 1 test suite ran. (30964 ms total) 2024-09-18T13:10:55.421 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 12 tests. 2024-09-18T13:10:55.424 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:10:55.424 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:10:55.425 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:10:55.425 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' pool = ec_io ']' 2024-09-18T13:10:55.425 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' pool = ec_list ']' 2024-09-18T13:10:55.425 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_pool 2024-09-18T13:10:55.444 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:10:55.445 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-18T13:10:55.445 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:10:55.445 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 6 tests from NeoRadosPools 2024-09-18T13:10:55.445 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-18T13:10:57.471 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosPools.PoolList (2026 ms) 2024-09-18T13:10:57.471 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-18T13:10:59.478 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosPools.PoolLookup (2007 ms) 2024-09-18T13:10:59.478 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2020 ms) 2024-09-18T13:11:01.498 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-18T13:11:05.424 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosPools.PoolDelete (3926 ms) 2024-09-18T13:11:05.424 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-18T13:11:07.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2004 ms) 2024-09-18T13:11:07.428 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-18T13:11:09.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2015 ms) 2024-09-18T13:11:09.444 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 6 tests from NeoRadosPools (13998 ms total) 2024-09-18T13:11:09.444 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:11:09.444 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:11:09.444 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 6 tests from 1 test suite ran. (13999 ms total) 2024-09-18T13:11:09.444 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 6 tests. 2024-09-18T13:11:09.446 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:11:09.446 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:11:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:11:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' read_operations = ec_io ']' 2024-09-18T13:11:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' read_operations = ec_list ']' 2024-09-18T13:11:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_read_operations 2024-09-18T13:11:09.468 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:11:09.468 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-18T13:11:09.468 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:11:09.468 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-18T13:11:09.468 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-18T13:11:12.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2985 ms) 2024-09-18T13:11:12.454 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-18T13:11:15.425 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.AssertExists (2972 ms) 2024-09-18T13:11:15.426 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-18T13:11:18.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3008 ms) 2024-09-18T13:11:18.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-18T13:11:21.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3015 ms) 2024-09-18T13:11:21.448 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-18T13:11:24.461 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.Read (3013 ms) 2024-09-18T13:11:24.461 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-18T13:11:27.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.Checksum (2979 ms) 2024-09-18T13:11:27.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-18T13:11:30.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3009 ms) 2024-09-18T13:11:30.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-18T13:11:33.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.ShortRead (3021 ms) 2024-09-18T13:11:33.471 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-18T13:11:36.483 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.Exec (3012 ms) 2024-09-18T13:11:36.483 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-18T13:11:39.494 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.Stat (3012 ms) 2024-09-18T13:11:39.494 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-18T13:11:42.502 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.Omap (3008 ms) 2024-09-18T13:11:42.503 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-18T13:11:45.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.OmapNuls (2930 ms) 2024-09-18T13:11:45.432 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-18T13:11:48.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3008 ms) 2024-09-18T13:11:48.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-18T13:11:51.461 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosReadOps.CmpExt (3021 ms) 2024-09-18T13:11:51.462 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 14 tests from NeoRadosReadOps (41993 ms total) 2024-09-18T13:11:51.462 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:11:51.462 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:11:51.462 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 14 tests from 1 test suite ran. (41993 ms total) 2024-09-18T13:11:51.462 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 14 tests. 2024-09-18T13:11:51.467 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:11:51.467 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:11:51.467 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:11:51.467 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' snapshots = ec_io ']' 2024-09-18T13:11:51.467 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' snapshots = ec_list ']' 2024-09-18T13:11:51.467 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_snapshots 2024-09-18T13:11:51.486 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:11:51.486 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-18T13:11:51.486 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:11:51.486 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-18T13:11:51.486 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-18T13:11:56.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSnapshots.SnapList (4953 ms) 2024-09-18T13:11:56.439 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-18T13:12:01.462 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (5023 ms) 2024-09-18T13:12:01.462 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-18T13:12:05.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSnapshots.Rollback (3975 ms) 2024-09-18T13:12:05.437 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-18T13:12:10.458 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5021 ms) 2024-09-18T13:12:10.459 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-18T13:12:17.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (6988 ms) 2024-09-18T13:12:17.446 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 5 tests from NeoRadosSnapshots (25960 ms total) 2024-09-18T13:12:17.446 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:12:17.446 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-18T13:12:17.446 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-18T13:12:22.472 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5026 ms) 2024-09-18T13:12:22.472 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-18T13:12:23.480 INFO:tasks.workunit.client.0.smithi120.stderr:Not supported by crimson yet. Skipped 2024-09-18T13:12:24.480 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2008 ms) 2024-09-18T13:12:24.480 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-18T13:12:25.443 INFO:tasks.workunit.client.0.smithi120.stderr:Not supported by crimson yet. Skipped 2024-09-18T13:12:26.442 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (1962 ms) 2024-09-18T13:12:26.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-18T13:12:32.464 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6022 ms) 2024-09-18T13:12:32.464 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-18T13:12:36.501 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4037 ms) 2024-09-18T13:12:36.501 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-18T13:12:39.518 INFO:tasks.workunit.client.0.smithi120.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi120-95817-11. 2024-09-18T13:12:40.520 INFO:tasks.workunit.client.0.smithi120.stdout:Waiting for snaps to purge. 2024-09-18T13:12:56.459 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19957 ms) 2024-09-18T13:12:56.459 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (39012 ms total) 2024-09-18T13:12:56.460 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:12:56.460 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:12:56.460 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 11 tests from 2 test suites ran. (64972 ms total) 2024-09-18T13:12:56.460 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 11 tests. 2024-09-18T13:12:56.462 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:12:56.463 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:12:56.463 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:12:56.463 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' watch_notify = ec_io ']' 2024-09-18T13:12:56.463 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' watch_notify = ec_list ']' 2024-09-18T13:12:56.463 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_watch_notify 2024-09-18T13:12:56.484 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:12:56.484 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-18T13:12:56.484 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:12:56.484 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-18T13:12:56.485 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-18T13:12:58.769 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 25778960 notify_id 2847563317255 notifier_gid 15928 2024-09-18T13:12:59.480 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2996 ms) 2024-09-18T13:12:59.481 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-18T13:13:01.813 INFO:tasks.workunit.client.0.smithi120.stdout:Trying... 2024-09-18T13:13:01.816 INFO:tasks.workunit.client.0.smithi120.stdout:handle_notify cookie 38317808 notify_id 2860448219143 notifier_gid 15931 2024-09-18T13:13:01.817 INFO:tasks.workunit.client.0.smithi120.stdout:Waiting for 3.000000000s 2024-09-18T13:13:02.816 INFO:tasks.workunit.client.0.smithi120.stdout:Timed out. 2024-09-18T13:13:02.828 INFO:tasks.workunit.client.0.smithi120.stdout:Flushing... 2024-09-18T13:13:02.828 INFO:tasks.workunit.client.0.smithi120.stdout:Flushed... 2024-09-18T13:13:06.457 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6977 ms) 2024-09-18T13:13:06.457 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 2 tests from NeoRadosWatchNotify (9973 ms total) 2024-09-18T13:13:06.457 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:13:06.457 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:13:06.457 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 2 tests from 1 test suite ran. (9973 ms total) 2024-09-18T13:13:06.457 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 2 tests. 2024-09-18T13:13:06.460 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-18T13:13:06.460 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:13:06.460 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 1 -eq 1 ']' 2024-09-18T13:13:06.460 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' write_operations = ec_io ']' 2024-09-18T13:13:06.461 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' write_operations = ec_list ']' 2024-09-18T13:13:06.461 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph_test_neorados_write_operations 2024-09-18T13:13:06.484 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-18T13:13:06.484 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-18T13:13:06.484 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-18T13:13:06.485 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-18T13:13:06.485 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-18T13:13:09.469 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2985 ms) 2024-09-18T13:13:09.469 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-18T13:13:12.481 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3012 ms) 2024-09-18T13:13:12.481 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-18T13:13:15.454 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWriteOps.Xattrs (2973 ms) 2024-09-18T13:13:15.454 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-18T13:13:18.462 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWriteOps.Write (3008 ms) 2024-09-18T13:13:18.463 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-18T13:13:21.479 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWriteOps.Exec (3016 ms) 2024-09-18T13:13:21.479 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-18T13:13:24.490 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3012 ms) 2024-09-18T13:13:24.490 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-18T13:13:34.848 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] NeoRadosWriteOps.CmpExt (10357 ms) 2024-09-18T13:13:34.848 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 7 tests from NeoRadosWriteOps (28363 ms total) 2024-09-18T13:13:34.848 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-18T13:13:34.848 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-18T13:13:34.848 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 7 tests from 1 test suite ran. (28363 ms total) 2024-09-18T13:13:34.848 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 7 tests. 2024-09-18T13:13:34.851 INFO:tasks.workunit.client.0.smithi120.stderr:+ ret=0 2024-09-18T13:13:34.851 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -eq 1 ']' 2024-09-18T13:13:34.851 INFO:tasks.workunit.client.0.smithi120.stderr:+ exit 0 2024-09-18T13:13:34.851 INFO:tasks.workunit.client.0.smithi120.stderr:+ cleanup 2024-09-18T13:13:34.851 INFO:tasks.workunit.client.0.smithi120.stderr:+ pkill -P 30226 2024-09-18T13:13:34.883 INFO:tasks.workunit.client.0.smithi120.stderr:+ true 2024-09-18T13:13:34.884 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T13:13:34.884 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T13:13:34.955 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-18T13:13:34.957 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-18T13:13:34.957 DEBUG:teuthology.orchestra.run.smithi120:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-18T13:13:35.023 INFO:tasks.workunit.client.0.smithi120.stderr:++ uuidgen 2024-09-18T13:13:35.036 INFO:tasks.workunit.client.0.smithi120.stderr:+ p=247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:13:35.036 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool create 247c8d9d-0676-4971-be17-81eba57b92bd 12 2024-09-18T13:13:35.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.145+0000 7f5ec2874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:35.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.153+0000 7f5ec2874640 1 Processor -- start 2024-09-18T13:13:35.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.153+0000 7f5ec2874640 1 -- start start 2024-09-18T13:13:35.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.154+0000 7f5ec2874640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ebc074a00 0x7f5ebc09c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:35.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.154+0000 7f5ec2874640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ebc06eac0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.154+0000 7f5ec2874640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5ebc06ed40 con 0x7f5ebc074a00 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5eb3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ebc074a00 0x7f5ebc09c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5eb3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ebc074a00 0x7f5ebc09c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55300/0 (socket says 172.21.15.120:55300) 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5ebbfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5ebc0745f0 0x7f5ebc09c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40026/0 (socket says 172.21.15.120:40026) 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5eb3fff640 1 -- 172.21.15.120:0/1357286260 learned_addr learned my addr 172.21.15.120:0/1357286260 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5eb3fff640 1 -- 172.21.15.120:0/1357286260 >> v1:172.21.15.120:6789/0 conn(0x7f5ebc0745f0 legacy=0x7f5ebc09c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5eb3fff640 1 -- 172.21.15.120:0/1357286260 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc06efe0 con 0x7f5ebc074a00 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5ebb7fe640 1 -- 172.21.15.120:0/1357286260 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964533118 0 0) 0x7f5ebc06eac0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5eb3fff640 1 --2- 172.21.15.120:0/1357286260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc074a00 0x7f5ebc09c710 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08350b298446387 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5ebb7fe640 1 -- 172.21.15.120:0/1357286260 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5ea4009e50 con 0x7f5ebc074a00 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5ebb7fe640 1 -- 172.21.15.120:0/1357286260 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5ea400e230 con 0x7f5ebc074a00 2024-09-18T13:13:35.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.155+0000 7f5ebb7fe640 1 -- 172.21.15.120:0/1357286260 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5ea400e4d0 con 0x7f5ebc074a00 2024-09-18T13:13:35.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 1 -- 172.21.15.120:0/1357286260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc074a00 msgr2=0x7f5ebc09c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:35.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 1 --2- 172.21.15.120:0/1357286260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc074a00 0x7f5ebc09c710 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 1 -- 172.21.15.120:0/1357286260 shutdown_connections 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 1 --2- 172.21.15.120:0/1357286260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc074a00 0x7f5ebc09c710 unknown :-1 s=CLOSED pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 1 -- 172.21.15.120:0/1357286260 >> 172.21.15.120:0/1357286260 conn(0x7f5ebc0a0d70 msgr2=0x7f5ebc0a1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 1 -- 172.21.15.120:0/1357286260 shutdown_connections 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 1 -- 172.21.15.120:0/1357286260 wait complete. 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.156+0000 7f5ec2874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.158+0000 7f5ec2874640 1 Processor -- start 2024-09-18T13:13:35.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.158+0000 7f5ec2874640 1 -- start start 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ec2874640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc0745f0 0x7f5ebc12c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ec2874640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc12d4e0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ebbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc0745f0 0x7f5ebc12c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ebbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc0745f0 0x7f5ebc12c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55302/0 (socket says 172.21.15.120:55302) 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ebbfff640 1 -- 172.21.15.120:0/2699935912 learned_addr learned my addr 172.21.15.120:0/2699935912 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ebbfff640 1 -- 172.21.15.120:0/2699935912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc12dde0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ebbfff640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc0745f0 0x7f5ebc12c430 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5eac004b80 con 0x7f5ebc0745f0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5eac004ce0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ebc133170 con 0x7f5ebc0745f0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5eac007120 con 0x7f5ebc0745f0 2024-09-18T13:13:35.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.159+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ebc12f6c0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.161+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ebc09e310 con 0x7f5ebc0745f0 2024-09-18T13:13:35.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.161+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5eac0072d0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.161+0000 7f5eb97fa640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5e9c03e930 0x7f5e9c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:35.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.161+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(692..692 src has 408..692) ==== 3431+0+0 (crc 0 0 0) 0x7f5eac04fac0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.161+0000 7f5eb3fff640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5e9c03e930 0x7f5e9c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:35.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.162+0000 7f5eb3fff640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5e9c03e930 0x7f5e9c040e40 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:35.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.166+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f5eac00f230 con 0x7f5ebc0745f0 2024-09-18T13:13:35.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.343+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pg_num": 12} v 0) -- 0x7f5ebc06ab00 con 0x7f5ebc0745f0 2024-09-18T13:13:35.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.454+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pg_num": 12}]=0 pool '247c8d9d-0676-4971-be17-81eba57b92bd' created v693) ==== 176+0+0 (crc 0 0 0) 0x7f5eac00a0c0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.608+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pg_num": 12} v 0) -- 0x7f5ebc12ec00 con 0x7f5ebc0745f0 2024-09-18T13:13:35.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.609+0000 7f5eb97fa640 1 -- 172.21.15.120:0/2699935912 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pg_num": 12}]=0 pool '247c8d9d-0676-4971-be17-81eba57b92bd' already exists v693) ==== 183+0+0 (crc 0 0 0) 0x7f5eac00a7b0 con 0x7f5ebc0745f0 2024-09-18T13:13:35.610 INFO:tasks.workunit.client.0.smithi120.stderr:pool '247c8d9d-0676-4971-be17-81eba57b92bd' already exists 2024-09-18T13:13:35.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5e9c03e930 msgr2=0x7f5e9c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:35.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5e9c03e930 0x7f5e9c040e40 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc0745f0 msgr2=0x7f5ebc12c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:35.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc0745f0 0x7f5ebc12c430 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 shutdown_connections 2024-09-18T13:13:35.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5e9c03e930 0x7f5e9c040e40 unknown :-1 s=CLOSED pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 --2- 172.21.15.120:0/2699935912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ebc0745f0 0x7f5ebc12c430 unknown :-1 s=CLOSED pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 >> 172.21.15.120:0/2699935912 conn(0x7f5ebc0a0d70 msgr2=0x7f5ebc06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:35.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 shutdown_connections 2024-09-18T13:13:35.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.612+0000 7f5ec2874640 1 -- 172.21.15.120:0/2699935912 wait complete. 2024-09-18T13:13:35.622 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota 247c8d9d-0676-4971-be17-81eba57b92bd max_objects 10 2024-09-18T13:13:35.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.705+0000 7fe561311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:35.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.715+0000 7fe561311640 1 Processor -- start 2024-09-18T13:13:35.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.715+0000 7fe561311640 1 -- start start 2024-09-18T13:13:35.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe561311640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe55c09c6a0 0x7fe55c09cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:35.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe561311640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c09eb70 con 0x7fe55c09cff0 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe561311640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c076180 con 0x7fe55c09c6a0 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe55affd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe55c09c6a0 0x7fe55c09cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe5527fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe55c09cff0 0x7fe55c1332f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40036/0 (socket says 172.21.15.120:40036) 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe5527fc640 1 -- 172.21.15.120:0/1270439040 learned_addr learned my addr 172.21.15.120:0/1270439040 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe55affd640 1 -- 172.21.15.120:0/1270439040 >> v1:172.21.15.120:6789/0 conn(0x7fe55c09cff0 legacy=0x7fe55c1332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe55affd640 1 -- 172.21.15.120:0/1270439040 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c09e290 con 0x7fe55c09c6a0 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.716+0000 7fe55affd640 1 --2- 172.21.15.120:0/1270439040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c09cab0 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8ec08403c99d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe55a7fc640 1 -- 172.21.15.120:0/1270439040 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe54c009d90 con 0x7fe55c09c6a0 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe55a7fc640 1 -- 172.21.15.120:0/1270439040 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe54c00e230 con 0x7fe55c09c6a0 2024-09-18T13:13:35.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe55a7fc640 1 -- 172.21.15.120:0/1270439040 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe54c00e4d0 con 0x7fe55c09c6a0 2024-09-18T13:13:35.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe561311640 1 -- 172.21.15.120:0/1270439040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 msgr2=0x7fe55c09cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:35.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe561311640 1 --2- 172.21.15.120:0/1270439040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c09cab0 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe561311640 1 -- 172.21.15.120:0/1270439040 shutdown_connections 2024-09-18T13:13:35.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe561311640 1 --2- 172.21.15.120:0/1270439040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c09cab0 unknown :-1 s=CLOSED pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:35.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe561311640 1 -- 172.21.15.120:0/1270439040 >> 172.21.15.120:0/1270439040 conn(0x7fe55c0a30a0 msgr2=0x7fe55c0a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:35.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe561311640 1 -- 172.21.15.120:0/1270439040 shutdown_connections 2024-09-18T13:13:35.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.717+0000 7fe561311640 1 -- 172.21.15.120:0/1270439040 wait complete. 2024-09-18T13:13:35.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.718+0000 7fe561311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:35.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.719+0000 7fe561311640 1 Processor -- start 2024-09-18T13:13:35.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.719+0000 7fe561311640 1 -- start start 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.720+0000 7fe561311640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c12e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.720+0000 7fe561311640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1307a0 con 0x7fe55c09c6a0 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.720+0000 7fe55affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c12e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.720+0000 7fe55affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c12e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55322/0 (socket says 172.21.15.120:55322) 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.720+0000 7fe55affd640 1 -- 172.21.15.120:0/1271944868 learned_addr learned my addr 172.21.15.120:0/1271944868 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.721+0000 7fe55affd640 1 -- 172.21.15.120:0/1271944868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c09e080 con 0x7fe55c09c6a0 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.721+0000 7fe55affd640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c12e600 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.721+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe54c018040 con 0x7fe55c09c6a0 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.721+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe54c012650 con 0x7fe55c09c6a0 2024-09-18T13:13:35.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.721+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c12e2f0 con 0x7fe55c09c6a0 2024-09-18T13:13:35.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.721+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe54c0128f0 con 0x7fe55c09c6a0 2024-09-18T13:13:35.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.721+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c12df00 con 0x7fe55c09c6a0 2024-09-18T13:13:35.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.722+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe54c012af0 con 0x7fe55c09c6a0 2024-09-18T13:13:35.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.722+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55c051040 con 0x7fe55c09c6a0 2024-09-18T13:13:35.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.722+0000 7fe553fff640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe53c03e8e0 0x7fe53c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:35.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.722+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(693..693 src has 408..693) ==== 3806+0+0 (crc 0 0 0) 0x7fe54c052a60 con 0x7fe55c09c6a0 2024-09-18T13:13:35.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.723+0000 7fe5527fc640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe53c03e8e0 0x7fe53c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:35.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.723+0000 7fe5527fc640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe53c03e8e0 0x7fe53c040df0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:35.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.728+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fe54c017c40 con 0x7fe55c09c6a0 2024-09-18T13:13:35.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:35.904+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "10"} v 0) -- 0x7fe55c09da90 con 0x7fe55c09c6a0 2024-09-18T13:13:36.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:36.455+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v694) ==== 223+0+0 (crc 0 0 0) 0x7fe54c017640 con 0x7fe55c09c6a0 2024-09-18T13:13:36.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:36.608+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "10"} v 0) -- 0x7fe55c074650 con 0x7fe55c09c6a0 2024-09-18T13:13:37.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.459+0000 7fe553fff640 1 -- 172.21.15.120:0/1271944868 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v695) ==== 223+0+0 (crc 0 0 0) 0x7fe54c017820 con 0x7fe55c09c6a0 2024-09-18T13:13:37.460 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_objects = 10 for pool 247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:13:37.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe53c03e8e0 msgr2=0x7fe53c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:37.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe53c03e8e0 0x7fe53c040df0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:37.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 msgr2=0x7fe55c12e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:37.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c12e600 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:37.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 shutdown_connections 2024-09-18T13:13:37.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe53c03e8e0 0x7fe53c040df0 unknown :-1 s=CLOSED pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:37.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 --2- 172.21.15.120:0/1271944868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe55c09c6a0 0x7fe55c12e600 unknown :-1 s=CLOSED pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:37.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 >> 172.21.15.120:0/1271944868 conn(0x7fe55c0a30a0 msgr2=0x7fe55c071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:37.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 shutdown_connections 2024-09-18T13:13:37.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.461+0000 7fe561311640 1 -- 172.21.15.120:0/1271944868 wait complete. 2024-09-18T13:13:37.478 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool application enable 247c8d9d-0676-4971-be17-81eba57b92bd rados 2024-09-18T13:13:37.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.565+0000 7ffa37711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:37.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.575+0000 7ffa37711640 1 Processor -- start 2024-09-18T13:13:37.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.575+0000 7ffa37711640 1 -- start start 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.576+0000 7ffa37711640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffa30132f70 0x7ffa30133380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.576+0000 7ffa37711640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa300a08a0 con 0x7ffa301338c0 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.576+0000 7ffa37711640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3009e990 con 0x7ffa30132f70 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.576+0000 7ffa354ad640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffa30132f70 0x7ffa30133380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.576+0000 7ffa34cac640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ffa301338c0 0x7ffa3006e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40044/0 (socket says 172.21.15.120:40044) 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.576+0000 7ffa34cac640 1 -- 172.21.15.120:0/3901997772 learned_addr learned my addr 172.21.15.120:0/3901997772 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.577+0000 7ffa354ad640 1 -- 172.21.15.120:0/3901997772 >> v1:172.21.15.120:6789/0 conn(0x7ffa301338c0 legacy=0x7ffa3006e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.577+0000 7ffa354ad640 1 -- 172.21.15.120:0/3901997772 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3009ee10 con 0x7ffa30132f70 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.577+0000 7ffa354ad640 1 --2- 172.21.15.120:0/3901997772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa30133380 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a41d8d6c9011cec server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.577+0000 7ffa27fff640 1 -- 172.21.15.120:0/3901997772 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa2c009d90 con 0x7ffa30132f70 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.577+0000 7ffa27fff640 1 -- 172.21.15.120:0/3901997772 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffa2c00e230 con 0x7ffa30132f70 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.577+0000 7ffa27fff640 1 -- 172.21.15.120:0/3901997772 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa2c00e4d0 con 0x7ffa30132f70 2024-09-18T13:13:37.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 1 -- 172.21.15.120:0/3901997772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 msgr2=0x7ffa30133380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 1 --2- 172.21.15.120:0/3901997772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa30133380 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 1 -- 172.21.15.120:0/3901997772 shutdown_connections 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 1 --2- 172.21.15.120:0/3901997772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa30133380 unknown :-1 s=CLOSED pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 1 -- 172.21.15.120:0/3901997772 >> 172.21.15.120:0/3901997772 conn(0x7ffa3009d9e0 msgr2=0x7ffa3009ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 1 -- 172.21.15.120:0/3901997772 shutdown_connections 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 1 -- 172.21.15.120:0/3901997772 wait complete. 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.578+0000 7ffa37711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:37.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.579+0000 7ffa37711640 1 Processor -- start 2024-09-18T13:13:37.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.579+0000 7ffa37711640 1 -- start start 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.580+0000 7ffa37711640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa301202b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.580+0000 7ffa37711640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3011f8f0 con 0x7ffa30132f70 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.580+0000 7ffa354ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa301202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.580+0000 7ffa354ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa301202b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55354/0 (socket says 172.21.15.120:55354) 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.580+0000 7ffa354ad640 1 -- 172.21.15.120:0/3016577287 learned_addr learned my addr 172.21.15.120:0/3016577287 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.581+0000 7ffa354ad640 1 -- 172.21.15.120:0/3016577287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3011fe80 con 0x7ffa30132f70 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.581+0000 7ffa354ad640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa301202b0 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.581+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa2c014620 con 0x7ffa30132f70 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.581+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa30121320 con 0x7ffa30132f70 2024-09-18T13:13:37.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.581+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffa2c014780 con 0x7ffa30132f70 2024-09-18T13:13:37.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.581+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa2c014a20 con 0x7ffa30132f70 2024-09-18T13:13:37.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.581+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa30121bd0 con 0x7ffa30132f70 2024-09-18T13:13:37.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.582+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ffa2c014c20 con 0x7ffa30132f70 2024-09-18T13:13:37.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.582+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa300a1e90 con 0x7ffa30132f70 2024-09-18T13:13:37.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.582+0000 7ffa25ffb640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffa1403e8e0 0x7ffa14040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:37.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.582+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(695..695 src has 408..695) ==== 3806+0+0 (crc 0 0 0) 0x7ffa2c019040 con 0x7ffa30132f70 2024-09-18T13:13:37.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.583+0000 7ffa34cac640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffa1403e8e0 0x7ffa14040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:37.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.583+0000 7ffa34cac640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffa1403e8e0 0x7ffa14040df0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:37.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.588+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7ffa2c012390 con 0x7ffa30132f70 2024-09-18T13:13:37.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:37.767+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "app": "rados"} v 0) -- 0x7ffa30076080 con 0x7ffa30132f70 2024-09-18T13:13:38.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:38.459+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "app": "rados"}]=0 enabled application 'rados' on pool '247c8d9d-0676-4971-be17-81eba57b92bd' v696) ==== 213+0+0 (crc 0 0 0) 0x7ffa2c008f20 con 0x7ffa30132f70 2024-09-18T13:13:38.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:38.584+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "app": "rados"} v 0) -- 0x7ffa301220d0 con 0x7ffa30132f70 2024-09-18T13:13:39.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.468+0000 7ffa25ffb640 1 -- 172.21.15.120:0/3016577287 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "app": "rados"}]=0 enabled application 'rados' on pool '247c8d9d-0676-4971-be17-81eba57b92bd' v697) ==== 213+0+0 (crc 0 0 0) 0x7ffa2c018190 con 0x7ffa30132f70 2024-09-18T13:13:39.470 INFO:tasks.workunit.client.0.smithi120.stderr:enabled application 'rados' on pool '247c8d9d-0676-4971-be17-81eba57b92bd' 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffa1403e8e0 msgr2=0x7ffa14040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffa1403e8e0 0x7ffa14040df0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 msgr2=0x7ffa301202b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa301202b0 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 shutdown_connections 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffa1403e8e0 0x7ffa14040df0 unknown :-1 s=CLOSED pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 --2- 172.21.15.120:0/3016577287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa30132f70 0x7ffa301202b0 unknown :-1 s=CLOSED pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 >> 172.21.15.120:0/3016577287 conn(0x7ffa3009d9e0 msgr2=0x7ffa300a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 shutdown_connections 2024-09-18T13:13:39.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.473+0000 7ffa37711640 1 -- 172.21.15.120:0/3016577287 wait complete. 2024-09-18T13:13:39.491 INFO:tasks.workunit.client.0.smithi120.stderr:++ seq 1 10 2024-09-18T13:13:39.575 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:39.575 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj1 /etc/passwd 2024-09-18T13:13:39.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.616+0000 7f9af765fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.622+0000 7f9af765fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.622+0000 7f9af765fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.623+0000 7f9af765fec0 1 Processor -- start 2024-09-18T13:13:39.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.623+0000 7f9af765fec0 1 -- start start 2024-09-18T13:13:39.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9af765fec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x120a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9af765fec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1054520 con 0x11829b0 2024-09-18T13:13:39.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aef79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x120a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aef79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x120a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55380/0 (socket says 172.21.15.120:55380) 2024-09-18T13:13:39.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aef79b640 1 -- 172.21.15.120:0/854107560 learned_addr learned my addr 172.21.15.120:0/854107560 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aef79b640 1 -- 172.21.15.120:0/854107560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xff0e10 con 0x11829b0 2024-09-18T13:13:39.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aef79b640 1 --2- 172.21.15.120:0/854107560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x120a8f0 crc :-1 s=READY pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9722d31c82515fd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aedf98640 1 -- 172.21.15.120:0/854107560 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ae000b500 con 0x11829b0 2024-09-18T13:13:39.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aedf98640 1 -- 172.21.15.120:0/854107560 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9ae000b660 con 0x11829b0 2024-09-18T13:13:39.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.624+0000 7f9aedf98640 1 -- 172.21.15.120:0/854107560 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ae000b900 con 0x11829b0 2024-09-18T13:13:39.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.625+0000 7f9af765fec0 1 -- 172.21.15.120:0/854107560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 msgr2=0x120a8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.625+0000 7f9af765fec0 1 --2- 172.21.15.120:0/854107560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x120a8f0 crc :-1 s=READY pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.625+0000 7f9af765fec0 1 -- 172.21.15.120:0/854107560 shutdown_connections 2024-09-18T13:13:39.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.625+0000 7f9af765fec0 1 --2- 172.21.15.120:0/854107560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x120a8f0 unknown :-1 s=CLOSED pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.625+0000 7f9af765fec0 1 -- 172.21.15.120:0/854107560 >> 172.21.15.120:0/854107560 conn(0x1014770 msgr2=0x10ed2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.625+0000 7f9af765fec0 1 -- 172.21.15.120:0/854107560 shutdown_connections 2024-09-18T13:13:39.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.625+0000 7f9af765fec0 1 -- 172.21.15.120:0/854107560 wait complete. 2024-09-18T13:13:39.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.626+0000 7f9af765fec0 1 Processor -- start 2024-09-18T13:13:39.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.626+0000 7f9af765fec0 1 -- start start 2024-09-18T13:13:39.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.627+0000 7f9af765fec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x1217880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.627+0000 7f9af765fec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1052280 con 0x11829b0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.627+0000 7f9aef79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x1217880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.627+0000 7f9aef79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x1217880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55384/0 (socket says 172.21.15.120:55384) 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.627+0000 7f9aef79b640 1 -- 172.21.15.120:0/2711339360 learned_addr learned my addr 172.21.15.120:0/2711339360 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.628+0000 7f9aef79b640 1 -- 172.21.15.120:0/2711339360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xfe2920 con 0x11829b0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.628+0000 7f9aef79b640 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x1217880 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.628+0000 7f9aecf96640 1 -- 172.21.15.120:0/2711339360 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ae00111e0 con 0x11829b0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.628+0000 7f9aecf96640 1 -- 172.21.15.120:0/2711339360 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9ae0011880 con 0x11829b0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.628+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xfe2380 con 0x11829b0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.628+0000 7f9aecf96640 1 -- 172.21.15.120:0/2711339360 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ae00119f0 con 0x11829b0 2024-09-18T13:13:39.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.628+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1182520 con 0x11829b0 2024-09-18T13:13:39.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.629+0000 7f9aecf96640 1 -- 172.21.15.120:0/2711339360 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9ae0011bf0 con 0x11829b0 2024-09-18T13:13:39.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.629+0000 7f9aecf96640 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9ac803d170 0x7f9ac803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.630+0000 7f9aecf96640 1 -- 172.21.15.120:0/2711339360 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7f9ae00501a0 con 0x11829b0 2024-09-18T13:13:39.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.630+0000 7f9aeef9a640 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9ac803d170 0x7f9ac803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.630+0000 7f9af765fec0 1 --2- 172.21.15.120:0/2711339360 >> v2:172.21.15.176:6806/2606993558 conn(0x11834d0 0x1181460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.630+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1171af0 con 0x11834d0 2024-09-18T13:13:39.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.630+0000 7f9aeef9a640 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9ac803d170 0x7f9ac803f680 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.631+0000 7f9aeff9c640 1 --2- 172.21.15.120:0/2711339360 >> v2:172.21.15.176:6806/2606993558 conn(0x11834d0 0x1181460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:39.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.638+0000 7f9aeff9c640 1 --2- 172.21.15.120:0/2711339360 >> v2:172.21.15.176:6806/2606993558 conn(0x11834d0 0x1181460 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.652+0000 7f9aeff9c640 1 -- 172.21.15.120:0/2711339360 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9ad800a430 con 0x11834d0 2024-09-18T13:13:39.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.652+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 >> v2:172.21.15.176:6806/2606993558 conn(0x11834d0 msgr2=0x1181460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.652+0000 7f9af765fec0 1 --2- 172.21.15.120:0/2711339360 >> v2:172.21.15.176:6806/2606993558 conn(0x11834d0 0x1181460 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.652+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9ac803d170 msgr2=0x7f9ac803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9ac803d170 0x7f9ac803f680 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 msgr2=0x1217880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x1217880 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 shutdown_connections 2024-09-18T13:13:39.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 --2- 172.21.15.120:0/2711339360 >> v2:172.21.15.176:6806/2606993558 conn(0x11834d0 0x1181460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9ac803d170 0x7f9ac803f680 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 --2- 172.21.15.120:0/2711339360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x11829b0 0x1217880 unknown :-1 s=CLOSED pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 >> 172.21.15.120:0/2711339360 conn(0x1014770 msgr2=0x10ed2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 shutdown_connections 2024-09-18T13:13:39.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.653+0000 7f9af765fec0 1 -- 172.21.15.120:0/2711339360 wait complete. 2024-09-18T13:13:39.656 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:39.656 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj2 /etc/passwd 2024-09-18T13:13:39.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.694+0000 7fe0e4d20ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.699+0000 7fe0e4d20ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.699+0000 7fe0e4d20ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.700+0000 7fe0e4d20ec0 1 Processor -- start 2024-09-18T13:13:39.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.700+0000 7fe0e4d20ec0 1 -- start start 2024-09-18T13:13:39.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0e4d20ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x10771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0e4d20ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xec0520 con 0xf53fc0 2024-09-18T13:13:39.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0dd19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x10771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0dd19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x10771a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55392/0 (socket says 172.21.15.120:55392) 2024-09-18T13:13:39.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0dd19b640 1 -- 172.21.15.120:0/2378952244 learned_addr learned my addr 172.21.15.120:0/2378952244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0dd19b640 1 -- 172.21.15.120:0/2378952244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe5ce10 con 0xf53fc0 2024-09-18T13:13:39.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0dd19b640 1 --2- 172.21.15.120:0/2378952244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x10771a0 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ae1f471657a97e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0d6ffd640 1 -- 172.21.15.120:0/2378952244 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0c802dcc0 con 0xf53fc0 2024-09-18T13:13:39.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0d6ffd640 1 -- 172.21.15.120:0/2378952244 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe0c8035420 con 0xf53fc0 2024-09-18T13:13:39.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.701+0000 7fe0d6ffd640 1 -- 172.21.15.120:0/2378952244 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0c80356c0 con 0xf53fc0 2024-09-18T13:13:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.702+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/2378952244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 msgr2=0x10771a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.702+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/2378952244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x10771a0 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.702+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/2378952244 shutdown_connections 2024-09-18T13:13:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.702+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/2378952244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x10771a0 unknown :-1 s=CLOSED pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.702+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/2378952244 >> 172.21.15.120:0/2378952244 conn(0xe80770 msgr2=0xf57e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.702+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/2378952244 shutdown_connections 2024-09-18T13:13:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.702+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/2378952244 wait complete. 2024-09-18T13:13:39.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.703+0000 7fe0e4d20ec0 1 Processor -- start 2024-09-18T13:13:39.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.703+0000 7fe0e4d20ec0 1 -- start start 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0e4d20ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x1061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0e4d20ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xebe280 con 0xf53fc0 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0dd19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x1061850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0dd19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x1061850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55396/0 (socket says 172.21.15.120:55396) 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0dd19b640 1 -- 172.21.15.120:0/3226720362 learned_addr learned my addr 172.21.15.120:0/3226720362 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0dd19b640 1 -- 172.21.15.120:0/3226720362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe4e920 con 0xf53fc0 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0dd19b640 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x1061850 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0d5ffb640 1 -- 172.21.15.120:0/3226720362 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0c803b040 con 0xf53fc0 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0d5ffb640 1 -- 172.21.15.120:0/3226720362 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe0c802db90 con 0xf53fc0 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0d5ffb640 1 -- 172.21.15.120:0/3226720362 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0c8036e20 con 0xf53fc0 2024-09-18T13:13:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xe4e380 con 0xf53fc0 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.704+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1061300 con 0xf53fc0 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.705+0000 7fe0d5ffb640 1 -- 172.21.15.120:0/3226720362 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe0c803e040 con 0xf53fc0 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.706+0000 7fe0d5ffb640 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe0c403d1c0 0x7fe0c403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.706+0000 7fe0d5ffb640 1 -- 172.21.15.120:0/3226720362 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7fe0c8076140 con 0xf53fc0 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.706+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/3226720362 >> v2:172.21.15.120:6803/3478481720 conn(0xf5c130 0x1081810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.706+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 --> v2:172.21.15.120:6803/3478481720 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1063f40 con 0xf5c130 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.706+0000 7fe0dc99a640 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe0c403d1c0 0x7fe0c403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.706+0000 7fe0dc99a640 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe0c403d1c0 0x7fe0c403f6d0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.707+0000 7fe0dd99c640 1 --2- 172.21.15.120:0/3226720362 >> v2:172.21.15.120:6803/3478481720 conn(0xf5c130 0x1081810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.710+0000 7fe0dd99c640 1 --2- 172.21.15.120:0/3226720362 >> v2:172.21.15.120:6803/3478481720 conn(0xf5c130 0x1081810 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0dd99c640 1 -- 172.21.15.120:0/3226720362 <== osd.1 v2:172.21.15.120:6803/3478481720 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe0d000a430 con 0xf5c130 2024-09-18T13:13:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 >> v2:172.21.15.120:6803/3478481720 conn(0xf5c130 msgr2=0x1081810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/3226720362 >> v2:172.21.15.120:6803/3478481720 conn(0xf5c130 0x1081810 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe0c403d1c0 msgr2=0x7fe0c403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe0c403d1c0 0x7fe0c403f6d0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 msgr2=0x1061850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x1061850 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 shutdown_connections 2024-09-18T13:13:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/3226720362 >> v2:172.21.15.120:6803/3478481720 conn(0xf5c130 0x1081810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fe0c403d1c0 0x7fe0c403f6d0 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 --2- 172.21.15.120:0/3226720362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf53fc0 0x1061850 unknown :-1 s=CLOSED pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.722+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 >> 172.21.15.120:0/3226720362 conn(0xe80770 msgr2=0xf57e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.723+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 shutdown_connections 2024-09-18T13:13:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.723+0000 7fe0e4d20ec0 1 -- 172.21.15.120:0/3226720362 wait complete. 2024-09-18T13:13:39.726 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:39.726 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj3 /etc/passwd 2024-09-18T13:13:39.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.761+0000 7fa1d8548ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.766+0000 7fa1d8548ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.766+0000 7fa1d8548ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.767+0000 7fa1d8548ec0 1 Processor -- start 2024-09-18T13:13:39.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.767+0000 7fa1d8548ec0 1 -- start start 2024-09-18T13:13:39.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.768+0000 7fa1d8548ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d5fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.768+0000 7fa1d8548ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1ba5520 con 0x1c38fc0 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.768+0000 7fa1d083f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d5fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.768+0000 7fa1d083f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d5fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55402/0 (socket says 172.21.15.120:55402) 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.768+0000 7fa1d083f640 1 -- 172.21.15.120:0/4270869223 learned_addr learned my addr 172.21.15.120:0/4270869223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.768+0000 7fa1d083f640 1 -- 172.21.15.120:0/4270869223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b41e10 con 0x1c38fc0 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.768+0000 7fa1d083f640 1 --2- 172.21.15.120:0/4270869223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d5fc60 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba7907d7d63d10c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1caffd640 1 -- 172.21.15.120:0/4270869223 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa1bc02dc90 con 0x1c38fc0 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1caffd640 1 -- 172.21.15.120:0/4270869223 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa1bc02de90 con 0x1c38fc0 2024-09-18T13:13:39.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1caffd640 1 -- 172.21.15.120:0/4270869223 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa1bc00a170 con 0x1c38fc0 2024-09-18T13:13:39.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/4270869223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 msgr2=0x1d5fc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/4270869223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d5fc60 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/4270869223 shutdown_connections 2024-09-18T13:13:39.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/4270869223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d5fc60 unknown :-1 s=CLOSED pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/4270869223 >> 172.21.15.120:0/4270869223 conn(0x1b65770 msgr2=0x1c3ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/4270869223 shutdown_connections 2024-09-18T13:13:39.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.769+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/4270869223 wait complete. 2024-09-18T13:13:39.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.770+0000 7fa1d8548ec0 1 Processor -- start 2024-09-18T13:13:39.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.770+0000 7fa1d8548ec0 1 -- start start 2024-09-18T13:13:39.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d8548ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d46550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d8548ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1ba3280 con 0x1c38fc0 2024-09-18T13:13:39.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d083f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d46550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d083f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d46550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55408/0 (socket says 172.21.15.120:55408) 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d083f640 1 -- 172.21.15.120:0/446850676 learned_addr learned my addr 172.21.15.120:0/446850676 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d083f640 1 -- 172.21.15.120:0/446850676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b33920 con 0x1c38fc0 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d083f640 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d46550 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1c9ffb640 1 -- 172.21.15.120:0/446850676 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa1bc009620 con 0x1c38fc0 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1c9ffb640 1 -- 172.21.15.120:0/446850676 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa1bc009780 con 0x1c38fc0 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b33380 con 0x1c38fc0 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1c9ffb640 1 -- 172.21.15.120:0/446850676 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa1bc009a20 con 0x1c38fc0 2024-09-18T13:13:39.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.772+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1d46190 con 0x1c38fc0 2024-09-18T13:13:39.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.773+0000 7fa1c9ffb640 1 -- 172.21.15.120:0/446850676 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa1bc009bd0 con 0x1c38fc0 2024-09-18T13:13:39.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.774+0000 7fa1c9ffb640 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa1b803d1c0 0x7fa1b803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.774+0000 7fa1c9ffb640 1 -- 172.21.15.120:0/446850676 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7fa1bc032040 con 0x1c38fc0 2024-09-18T13:13:39.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.774+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/446850676 >> v2:172.21.15.176:6802/1480150686 conn(0x1c41130 0x1d68940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.774+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 --> v2:172.21.15.176:6802/1480150686 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1d48290 con 0x1c41130 2024-09-18T13:13:39.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.774+0000 7fa1cbfff640 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa1b803d1c0 0x7fa1b803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.774+0000 7fa1cbfff640 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa1b803d1c0 0x7fa1b803f6d0 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.775+0000 7fa1d1040640 1 --2- 172.21.15.120:0/446850676 >> v2:172.21.15.176:6802/1480150686 conn(0x1c41130 0x1d68940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:39.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.778+0000 7fa1d1040640 1 --2- 172.21.15.120:0/446850676 >> v2:172.21.15.176:6802/1480150686 conn(0x1c41130 0x1d68940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d1040640 1 -- 172.21.15.120:0/446850676 <== osd.2 v2:172.21.15.176:6802/1480150686 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa1c400a430 con 0x1c41130 2024-09-18T13:13:39.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 >> v2:172.21.15.176:6802/1480150686 conn(0x1c41130 msgr2=0x1d68940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/446850676 >> v2:172.21.15.176:6802/1480150686 conn(0x1c41130 0x1d68940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa1b803d1c0 msgr2=0x7fa1b803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa1b803d1c0 0x7fa1b803f6d0 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 msgr2=0x1d46550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d46550 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 shutdown_connections 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/446850676 >> v2:172.21.15.176:6802/1480150686 conn(0x1c41130 0x1d68940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa1b803d1c0 0x7fa1b803f6d0 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 --2- 172.21.15.120:0/446850676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1c38fc0 0x1d46550 unknown :-1 s=CLOSED pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 >> 172.21.15.120:0/446850676 conn(0x1b65770 msgr2=0x1c3a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 shutdown_connections 2024-09-18T13:13:39.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.793+0000 7fa1d8548ec0 1 -- 172.21.15.120:0/446850676 wait complete. 2024-09-18T13:13:39.796 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:39.796 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj4 /etc/passwd 2024-09-18T13:13:39.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.831+0000 7f6308037ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.837+0000 7f6308037ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.837+0000 7f6308037ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.837+0000 7f6308037ec0 1 Processor -- start 2024-09-18T13:13:39.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.837+0000 7f6308037ec0 1 -- start start 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.838+0000 7f6308037ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x21e9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.838+0000 7f6308037ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x2150520 con 0x227bd10 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.838+0000 7f62fb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x21e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.838+0000 7f62fb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x21e9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55436/0 (socket says 172.21.15.120:55436) 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.838+0000 7f62fb7fe640 1 -- 172.21.15.120:0/2411176412 learned_addr learned my addr 172.21.15.120:0/2411176412 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.839+0000 7f62fb7fe640 1 -- 172.21.15.120:0/2411176412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20ece10 con 0x227bd10 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.839+0000 7f62fb7fe640 1 --2- 172.21.15.120:0/2411176412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x21e9970 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47c0d23a697bd15 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.839+0000 7f62fa7fc640 1 -- 172.21.15.120:0/2411176412 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62ec00c490 con 0x227bd10 2024-09-18T13:13:39.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.839+0000 7f62fa7fc640 1 -- 172.21.15.120:0/2411176412 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62ec00c5f0 con 0x227bd10 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.839+0000 7f62fa7fc640 1 -- 172.21.15.120:0/2411176412 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62ec00c890 con 0x227bd10 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 -- 172.21.15.120:0/2411176412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 msgr2=0x21e9970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 --2- 172.21.15.120:0/2411176412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x21e9970 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 -- 172.21.15.120:0/2411176412 shutdown_connections 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 --2- 172.21.15.120:0/2411176412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x21e9970 unknown :-1 s=CLOSED pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 -- 172.21.15.120:0/2411176412 >> 172.21.15.120:0/2411176412 conn(0x2110770 msgr2=0x21ee370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 -- 172.21.15.120:0/2411176412 shutdown_connections 2024-09-18T13:13:39.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 -- 172.21.15.120:0/2411176412 wait complete. 2024-09-18T13:13:39.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 Processor -- start 2024-09-18T13:13:39.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.840+0000 7f6308037ec0 1 -- start start 2024-09-18T13:13:39.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.841+0000 7f6308037ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x227ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.841+0000 7f6308037ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x214e280 con 0x227bd10 2024-09-18T13:13:39.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62fb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x227ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62fb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x227ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55450/0 (socket says 172.21.15.120:55450) 2024-09-18T13:13:39.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62fb7fe640 1 -- 172.21.15.120:0/171475867 learned_addr learned my addr 172.21.15.120:0/171475867 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62fb7fe640 1 -- 172.21.15.120:0/171475867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20de920 con 0x227bd10 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62fb7fe640 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x227ab30 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62f97fa640 1 -- 172.21.15.120:0/171475867 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62ec0111e0 con 0x227bd10 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62f97fa640 1 -- 172.21.15.120:0/171475867 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62ec0119d0 con 0x227bd10 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f62f97fa640 1 -- 172.21.15.120:0/171475867 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62ec011b40 con 0x227bd10 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x20de380 con 0x227bd10 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.842+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x226fbf0 con 0x227bd10 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.843+0000 7f62f97fa640 1 -- 172.21.15.120:0/171475867 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f62ec011cf0 con 0x227bd10 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.843+0000 7f62f97fa640 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f62dc03d1c0 0x7f62dc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.843+0000 7f62f97fa640 1 -- 172.21.15.120:0/171475867 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7f62ec0501b0 con 0x227bd10 2024-09-18T13:13:39.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.844+0000 7f6308037ec0 1 --2- 172.21.15.120:0/171475867 >> v2:172.21.15.176:6806/2606993558 conn(0x227c830 0x226c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.844+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x226ef60 con 0x227c830 2024-09-18T13:13:39.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.844+0000 7f62f2ffd640 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f62dc03d1c0 0x7f62dc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.844+0000 7f62f2ffd640 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f62dc03d1c0 0x7f62dc03f6d0 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.844+0000 7f630099c640 1 --2- 172.21.15.120:0/171475867 >> v2:172.21.15.176:6806/2606993558 conn(0x227c830 0x226c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:39.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.848+0000 7f630099c640 1 --2- 172.21.15.120:0/171475867 >> v2:172.21.15.176:6806/2606993558 conn(0x227c830 0x226c660 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f630099c640 1 -- 172.21.15.120:0/171475867 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f400a430 con 0x227c830 2024-09-18T13:13:39.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 >> v2:172.21.15.176:6806/2606993558 conn(0x227c830 msgr2=0x226c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 --2- 172.21.15.120:0/171475867 >> v2:172.21.15.176:6806/2606993558 conn(0x227c830 0x226c660 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f62dc03d1c0 msgr2=0x7f62dc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f62dc03d1c0 0x7f62dc03f6d0 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 msgr2=0x227ab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x227ab30 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 shutdown_connections 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 --2- 172.21.15.120:0/171475867 >> v2:172.21.15.176:6806/2606993558 conn(0x227c830 0x226c660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.861+0000 7f6308037ec0 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f62dc03d1c0 0x7f62dc03f6d0 unknown :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.862+0000 7f6308037ec0 1 --2- 172.21.15.120:0/171475867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x227bd10 0x227ab30 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.862+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 >> 172.21.15.120:0/171475867 conn(0x2110770 msgr2=0x227b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.862+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 shutdown_connections 2024-09-18T13:13:39.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.862+0000 7f6308037ec0 1 -- 172.21.15.120:0/171475867 wait complete. 2024-09-18T13:13:39.865 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:39.865 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj5 /etc/passwd 2024-09-18T13:13:39.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.899+0000 7fd0144e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.904+0000 7fd0144e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.905+0000 7fd0144e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.905+0000 7fd0144e4ec0 1 Processor -- start 2024-09-18T13:13:39.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.905+0000 7fd0144e4ec0 1 -- start start 2024-09-18T13:13:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.906+0000 7fd0144e4ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1ae89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.906+0000 7fd0144e4ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1a49520 con 0x1b779b0 2024-09-18T13:13:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.906+0000 7fd00c99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1ae89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.907+0000 7fd00c99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1ae89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55464/0 (socket says 172.21.15.120:55464) 2024-09-18T13:13:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.907+0000 7fd00c99b640 1 -- 172.21.15.120:0/817181813 learned_addr learned my addr 172.21.15.120:0/817181813 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.907+0000 7fd00c99b640 1 -- 172.21.15.120:0/817181813 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19e5e10 con 0x1b779b0 2024-09-18T13:13:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.907+0000 7fd00c99b640 1 --2- 172.21.15.120:0/817181813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1ae89b0 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be4b9229adcd892 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.907+0000 7fd006ffd640 1 -- 172.21.15.120:0/817181813 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff800b580 con 0x1b779b0 2024-09-18T13:13:39.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.907+0000 7fd006ffd640 1 -- 172.21.15.120:0/817181813 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcff800b6e0 con 0x1b779b0 2024-09-18T13:13:39.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.907+0000 7fd006ffd640 1 -- 172.21.15.120:0/817181813 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff800b980 con 0x1b779b0 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/817181813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 msgr2=0x1ae89b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/817181813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1ae89b0 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/817181813 shutdown_connections 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/817181813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1ae89b0 unknown :-1 s=CLOSED pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/817181813 >> 172.21.15.120:0/817181813 conn(0x1a09770 msgr2=0x1ae0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/817181813 shutdown_connections 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/817181813 wait complete. 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 Processor -- start 2024-09-18T13:13:39.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.908+0000 7fd0144e4ec0 1 -- start start 2024-09-18T13:13:39.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.909+0000 7fd0144e4ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1b63e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.909+0000 7fd0144e4ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1a47280 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd00c99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1b63e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd00c99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1b63e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55466/0 (socket says 172.21.15.120:55466) 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd00c99b640 1 -- 172.21.15.120:0/2895196809 learned_addr learned my addr 172.21.15.120:0/2895196809 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd00c99b640 1 -- 172.21.15.120:0/2895196809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19d7920 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd00c99b640 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1b63e70 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd005ffb640 1 -- 172.21.15.120:0/2895196809 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff80129c0 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd005ffb640 1 -- 172.21.15.120:0/2895196809 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcff8005040 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x19d7380 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd005ffb640 1 -- 172.21.15.120:0/2895196809 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff8012c50 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.910+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1b64e00 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.911+0000 7fd005ffb640 1 -- 172.21.15.120:0/2895196809 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcff800d040 con 0x1b779b0 2024-09-18T13:13:39.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.911+0000 7fd005ffb640 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcfe803d1c0 0x7fcfe803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.911+0000 7fd005ffb640 1 -- 172.21.15.120:0/2895196809 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7fcff800a040 con 0x1b779b0 2024-09-18T13:13:39.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.911+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/2895196809 >> v2:172.21.15.120:6801/1764758402 conn(0x1b784d0 0x1c0ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.911+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1b666f0 con 0x1b784d0 2024-09-18T13:13:39.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.912+0000 7fcfff7fe640 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcfe803d1c0 0x7fcfe803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.912+0000 7fcfff7fe640 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcfe803d1c0 0x7fcfe803f6d0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.912+0000 7fd00d19c640 1 --2- 172.21.15.120:0/2895196809 >> v2:172.21.15.120:6801/1764758402 conn(0x1b784d0 0x1c0ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:39.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.915+0000 7fd00d19c640 1 --2- 172.21.15.120:0/2895196809 >> v2:172.21.15.120:6801/1764758402 conn(0x1b784d0 0x1c0ccf0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd00d19c640 1 -- 172.21.15.120:0/2895196809 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd00000a430 con 0x1b784d0 2024-09-18T13:13:39.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 >> v2:172.21.15.120:6801/1764758402 conn(0x1b784d0 msgr2=0x1c0ccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/2895196809 >> v2:172.21.15.120:6801/1764758402 conn(0x1b784d0 0x1c0ccf0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcfe803d1c0 msgr2=0x7fcfe803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcfe803d1c0 0x7fcfe803f6d0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 msgr2=0x1b63e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1b63e70 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 shutdown_connections 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/2895196809 >> v2:172.21.15.120:6801/1764758402 conn(0x1b784d0 0x1c0ccf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fcfe803d1c0 0x7fcfe803f6d0 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 --2- 172.21.15.120:0/2895196809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1b779b0 0x1b63e70 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 >> 172.21.15.120:0/2895196809 conn(0x1a09770 msgr2=0x1ae0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 shutdown_connections 2024-09-18T13:13:39.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.928+0000 7fd0144e4ec0 1 -- 172.21.15.120:0/2895196809 wait complete. 2024-09-18T13:13:39.931 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:39.931 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj6 /etc/passwd 2024-09-18T13:13:39.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.967+0000 7f704bc34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.972+0000 7f704bc34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.972+0000 7f704bc34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:39.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.972+0000 7f704bc34ec0 1 Processor -- start 2024-09-18T13:13:39.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.973+0000 7f704bc34ec0 1 -- start start 2024-09-18T13:13:39.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.973+0000 7f704bc34ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e13bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.973+0000 7f704bc34ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1c5c520 con 0x1ceffc0 2024-09-18T13:13:39.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e13bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e13bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55482/0 (socket says 172.21.15.120:55482) 2024-09-18T13:13:39.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703effd640 1 -- 172.21.15.120:0/499781770 learned_addr learned my addr 172.21.15.120:0/499781770 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703effd640 1 -- 172.21.15.120:0/499781770 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1bf8e10 con 0x1ceffc0 2024-09-18T13:13:39.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703effd640 1 --2- 172.21.15.120:0/499781770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e13bb0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2337d6c7c4abdb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703d7fa640 1 -- 172.21.15.120:0/499781770 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f70380061e0 con 0x1ceffc0 2024-09-18T13:13:39.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703d7fa640 1 -- 172.21.15.120:0/499781770 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7038006340 con 0x1ceffc0 2024-09-18T13:13:39.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.974+0000 7f703d7fa640 1 -- 172.21.15.120:0/499781770 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7038004880 con 0x1ceffc0 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.975+0000 7f704bc34ec0 1 -- 172.21.15.120:0/499781770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 msgr2=0x1e13bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.975+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/499781770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e13bb0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.975+0000 7f704bc34ec0 1 -- 172.21.15.120:0/499781770 shutdown_connections 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.975+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/499781770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e13bb0 unknown :-1 s=CLOSED pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.975+0000 7f704bc34ec0 1 -- 172.21.15.120:0/499781770 >> 172.21.15.120:0/499781770 conn(0x1c1c770 msgr2=0x1cf1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.975+0000 7f704bc34ec0 1 -- 172.21.15.120:0/499781770 shutdown_connections 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.975+0000 7f704bc34ec0 1 -- 172.21.15.120:0/499781770 wait complete. 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.976+0000 7f704bc34ec0 1 Processor -- start 2024-09-18T13:13:39.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.976+0000 7f704bc34ec0 1 -- start start 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f704bc34ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e1f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f704bc34ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1c5a280 con 0x1ceffc0 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f703effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e1f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f703effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e1f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55496/0 (socket says 172.21.15.120:55496) 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f703effd640 1 -- 172.21.15.120:0/1175975142 learned_addr learned my addr 172.21.15.120:0/1175975142 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f703effd640 1 -- 172.21.15.120:0/1175975142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1bea920 con 0x1ceffc0 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f703effd640 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e1f700 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f7037fff640 1 -- 172.21.15.120:0/1175975142 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7038001ad0 con 0x1ceffc0 2024-09-18T13:13:39.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f7037fff640 1 -- 172.21.15.120:0/1175975142 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7038001c30 con 0x1ceffc0 2024-09-18T13:13:39.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1bea380 con 0x1ceffc0 2024-09-18T13:13:39.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f7037fff640 1 -- 172.21.15.120:0/1175975142 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7038001ed0 con 0x1ceffc0 2024-09-18T13:13:39.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.977+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e1f470 con 0x1ceffc0 2024-09-18T13:13:39.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.978+0000 7f7037fff640 1 -- 172.21.15.120:0/1175975142 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7038013340 con 0x1ceffc0 2024-09-18T13:13:39.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.978+0000 7f7037fff640 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f702003d1c0 0x7f702003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.978+0000 7f7037fff640 1 -- 172.21.15.120:0/1175975142 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7f703804f8d0 con 0x1ceffc0 2024-09-18T13:13:39.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.979+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/1175975142 >> v2:172.21.15.176:6806/2606993558 conn(0x1cf8300 0x1cde290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:39.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.979+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1dfc200 con 0x1cf8300 2024-09-18T13:13:39.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.979+0000 7f703e7fc640 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f702003d1c0 0x7f702003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:39.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.979+0000 7f703e7fc640 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f702003d1c0 0x7f702003f6d0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.980+0000 7f703f7fe640 1 --2- 172.21.15.120:0/1175975142 >> v2:172.21.15.176:6806/2606993558 conn(0x1cf8300 0x1cde290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:39.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.983+0000 7f703f7fe640 1 --2- 172.21.15.120:0/1175975142 >> v2:172.21.15.176:6806/2606993558 conn(0x1cf8300 0x1cde290 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f703f7fe640 1 -- 172.21.15.120:0/1175975142 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f703000c430 con 0x1cf8300 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 >> v2:172.21.15.176:6806/2606993558 conn(0x1cf8300 msgr2=0x1cde290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/1175975142 >> v2:172.21.15.176:6806/2606993558 conn(0x1cf8300 0x1cde290 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f702003d1c0 msgr2=0x7f702003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f702003d1c0 0x7f702003f6d0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 msgr2=0x1e1f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e1f700 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 shutdown_connections 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/1175975142 >> v2:172.21.15.176:6806/2606993558 conn(0x1cf8300 0x1cde290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f702003d1c0 0x7f702003f6d0 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 --2- 172.21.15.120:0/1175975142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1ceffc0 0x1e1f700 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:39.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 >> 172.21.15.120:0/1175975142 conn(0x1c1c770 msgr2=0x1cf16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:39.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 shutdown_connections 2024-09-18T13:13:39.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:39.996+0000 7f704bc34ec0 1 -- 172.21.15.120:0/1175975142 wait complete. 2024-09-18T13:13:39.999 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:39.999 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj7 /etc/passwd 2024-09-18T13:13:40.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.035+0000 7ffaee633ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.040+0000 7ffaee633ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.040+0000 7ffaee633ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.041+0000 7ffaee633ec0 1 Processor -- start 2024-09-18T13:13:40.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.041+0000 7ffaee633ec0 1 -- start start 2024-09-18T13:13:40.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffaee633ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x19368e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffaee633ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1896520 con 0x1929fc0 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae679b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x19368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae679b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x19368e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55516/0 (socket says 172.21.15.120:55516) 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae679b640 1 -- 172.21.15.120:0/2007148075 learned_addr learned my addr 172.21.15.120:0/2007148075 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae679b640 1 -- 172.21.15.120:0/2007148075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1832e10 con 0x1929fc0 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae679b640 1 --2- 172.21.15.120:0/2007148075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x19368e0 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fefc9f90fac880a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae4f98640 1 -- 172.21.15.120:0/2007148075 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffad002dcc0 con 0x1929fc0 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae4f98640 1 -- 172.21.15.120:0/2007148075 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffad0037370 con 0x1929fc0 2024-09-18T13:13:40.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.042+0000 7ffae4f98640 1 -- 172.21.15.120:0/2007148075 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffad0037610 con 0x1929fc0 2024-09-18T13:13:40.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.043+0000 7ffaee633ec0 1 -- 172.21.15.120:0/2007148075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 msgr2=0x19368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.043+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/2007148075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x19368e0 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.043+0000 7ffaee633ec0 1 -- 172.21.15.120:0/2007148075 shutdown_connections 2024-09-18T13:13:40.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.043+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/2007148075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x19368e0 unknown :-1 s=CLOSED pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.043+0000 7ffaee633ec0 1 -- 172.21.15.120:0/2007148075 >> 172.21.15.120:0/2007148075 conn(0x1856770 msgr2=0x192b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.043+0000 7ffaee633ec0 1 -- 172.21.15.120:0/2007148075 shutdown_connections 2024-09-18T13:13:40.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.043+0000 7ffaee633ec0 1 -- 172.21.15.120:0/2007148075 wait complete. 2024-09-18T13:13:40.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.044+0000 7ffaee633ec0 1 Processor -- start 2024-09-18T13:13:40.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.044+0000 7ffaee633ec0 1 -- start start 2024-09-18T13:13:40.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffaee633ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x1a38ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffaee633ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1894280 con 0x1929fc0 2024-09-18T13:13:40.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffae679b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x1a38ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffae679b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x1a38ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55518/0 (socket says 172.21.15.120:55518) 2024-09-18T13:13:40.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffae679b640 1 -- 172.21.15.120:0/3370337903 learned_addr learned my addr 172.21.15.120:0/3370337903 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffae679b640 1 -- 172.21.15.120:0/3370337903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1824920 con 0x1929fc0 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffae679b640 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x1a38ea0 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.045+0000 7ffadeffd640 1 -- 172.21.15.120:0/3370337903 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffad0037610 con 0x1929fc0 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.046+0000 7ffadeffd640 1 -- 172.21.15.120:0/3370337903 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffad002db90 con 0x1929fc0 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.046+0000 7ffadeffd640 1 -- 172.21.15.120:0/3370337903 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffad0039580 con 0x1929fc0 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.046+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1824380 con 0x1929fc0 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.046+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a3be40 con 0x1929fc0 2024-09-18T13:13:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.047+0000 7ffadeffd640 1 -- 172.21.15.120:0/3370337903 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ffad0039730 con 0x1929fc0 2024-09-18T13:13:40.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.047+0000 7ffadeffd640 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffacc03d1c0 0x7ffacc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.047+0000 7ffadeffd640 1 -- 172.21.15.120:0/3370337903 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7ffad0032040 con 0x1929fc0 2024-09-18T13:13:40.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.047+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/3370337903 >> v2:172.21.15.176:6802/1480150686 conn(0x1932130 0x1a4b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.047+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 --> v2:172.21.15.176:6802/1480150686 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1a3c800 con 0x1932130 2024-09-18T13:13:40.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.047+0000 7ffae5f9a640 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffacc03d1c0 0x7ffacc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.048+0000 7ffae5f9a640 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffacc03d1c0 0x7ffacc03f6d0 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.048+0000 7ffae6f9c640 1 --2- 172.21.15.120:0/3370337903 >> v2:172.21.15.176:6802/1480150686 conn(0x1932130 0x1a4b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:40.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.050+0000 7ffae6f9c640 1 --2- 172.21.15.120:0/3370337903 >> v2:172.21.15.176:6802/1480150686 conn(0x1932130 0x1a4b210 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffae6f9c640 1 -- 172.21.15.120:0/3370337903 <== osd.2 v2:172.21.15.176:6802/1480150686 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ffad800a430 con 0x1932130 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 >> v2:172.21.15.176:6802/1480150686 conn(0x1932130 msgr2=0x1a4b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/3370337903 >> v2:172.21.15.176:6802/1480150686 conn(0x1932130 0x1a4b210 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffacc03d1c0 msgr2=0x7ffacc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffacc03d1c0 0x7ffacc03f6d0 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 msgr2=0x1a38ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x1a38ea0 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 shutdown_connections 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/3370337903 >> v2:172.21.15.176:6802/1480150686 conn(0x1932130 0x1a4b210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7ffacc03d1c0 0x7ffacc03f6d0 unknown :-1 s=CLOSED pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 --2- 172.21.15.120:0/3370337903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1929fc0 0x1a38ea0 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 >> 172.21.15.120:0/3370337903 conn(0x1856770 msgr2=0x192b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 shutdown_connections 2024-09-18T13:13:40.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.064+0000 7ffaee633ec0 1 -- 172.21.15.120:0/3370337903 wait complete. 2024-09-18T13:13:40.068 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:40.068 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj8 /etc/passwd 2024-09-18T13:13:40.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.103+0000 7f4706842ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.108+0000 7f4706842ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.108+0000 7f4706842ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.108+0000 7f4706842ec0 1 Processor -- start 2024-09-18T13:13:40.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.108+0000 7f4706842ec0 1 -- start start 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.109+0000 7f4706842ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xc41070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.109+0000 7f4706842ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xba8520 con 0xc3bfc0 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.109+0000 7f46fe99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xc41070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.109+0000 7f46fe99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xc41070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55538/0 (socket says 172.21.15.120:55538) 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.109+0000 7f46fe99b640 1 -- 172.21.15.120:0/4041632583 learned_addr learned my addr 172.21.15.120:0/4041632583 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.110+0000 7f46fe99b640 1 -- 172.21.15.120:0/4041632583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb44e10 con 0xc3bfc0 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.110+0000 7f46fe99b640 1 --2- 172.21.15.120:0/4041632583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xc41070 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a1cd4cf6d5f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.110+0000 7f46fd198640 1 -- 172.21.15.120:0/4041632583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46e802dc90 con 0xc3bfc0 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.110+0000 7f46fd198640 1 -- 172.21.15.120:0/4041632583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46e800a040 con 0xc3bfc0 2024-09-18T13:13:40.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.110+0000 7f46fd198640 1 -- 172.21.15.120:0/4041632583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46e800a2e0 con 0xc3bfc0 2024-09-18T13:13:40.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 -- 172.21.15.120:0/4041632583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 msgr2=0xc41070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 --2- 172.21.15.120:0/4041632583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xc41070 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 -- 172.21.15.120:0/4041632583 shutdown_connections 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 --2- 172.21.15.120:0/4041632583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xc41070 unknown :-1 s=CLOSED pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 -- 172.21.15.120:0/4041632583 >> 172.21.15.120:0/4041632583 conn(0xb68770 msgr2=0xc3fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 -- 172.21.15.120:0/4041632583 shutdown_connections 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 -- 172.21.15.120:0/4041632583 wait complete. 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 Processor -- start 2024-09-18T13:13:40.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.111+0000 7f4706842ec0 1 -- start start 2024-09-18T13:13:40.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.112+0000 7f4706842ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xd5ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.112+0000 7f4706842ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xba6280 con 0xc3bfc0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46fe99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xd5ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46fe99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xd5ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55544/0 (socket says 172.21.15.120:55544) 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46fe99b640 1 -- 172.21.15.120:0/3731423652 learned_addr learned my addr 172.21.15.120:0/3731423652 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46fe99b640 1 -- 172.21.15.120:0/3731423652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb36920 con 0xc3bfc0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46fe99b640 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xd5ce40 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46f77fe640 1 -- 172.21.15.120:0/3731423652 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46e803b040 con 0xc3bfc0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46f77fe640 1 -- 172.21.15.120:0/3731423652 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46e803c040 con 0xc3bfc0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb36380 con 0xc3bfc0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f46f77fe640 1 -- 172.21.15.120:0/3731423652 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46e802db60 con 0xc3bfc0 2024-09-18T13:13:40.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.113+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd5e240 con 0xc3bfc0 2024-09-18T13:13:40.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.114+0000 7f46f77fe640 1 -- 172.21.15.120:0/3731423652 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f46e8035c00 con 0xc3bfc0 2024-09-18T13:13:40.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.114+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46e403d1c0 0x7f46e403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.114+0000 7f46f77fe640 1 -- 172.21.15.120:0/3731423652 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7f46e802de40 con 0xc3bfc0 2024-09-18T13:13:40.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.115+0000 7f4706842ec0 1 --2- 172.21.15.120:0/3731423652 >> v2:172.21.15.120:6801/1764758402 conn(0xc44130 0xd48a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.115+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0xd4c480 con 0xc44130 2024-09-18T13:13:40.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.115+0000 7f46fe19a640 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46e403d1c0 0x7f46e403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.115+0000 7f46fe19a640 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46e403d1c0 0x7f46e403f6d0 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.116+0000 7f46ff19c640 1 --2- 172.21.15.120:0/3731423652 >> v2:172.21.15.120:6801/1764758402 conn(0xc44130 0xd48a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:40.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.119+0000 7f46ff19c640 1 --2- 172.21.15.120:0/3731423652 >> v2:172.21.15.120:6801/1764758402 conn(0xc44130 0xd48a10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.131+0000 7f46ff19c640 1 -- 172.21.15.120:0/3731423652 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f46f000a430 con 0xc44130 2024-09-18T13:13:40.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 >> v2:172.21.15.120:6801/1764758402 conn(0xc44130 msgr2=0xd48a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 --2- 172.21.15.120:0/3731423652 >> v2:172.21.15.120:6801/1764758402 conn(0xc44130 0xd48a10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46e403d1c0 msgr2=0x7f46e403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46e403d1c0 0x7f46e403f6d0 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 msgr2=0xd5ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xd5ce40 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 shutdown_connections 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 --2- 172.21.15.120:0/3731423652 >> v2:172.21.15.120:6801/1764758402 conn(0xc44130 0xd48a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46e403d1c0 0x7f46e403f6d0 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 --2- 172.21.15.120:0/3731423652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xc3bfc0 0xd5ce40 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 >> 172.21.15.120:0/3731423652 conn(0xb68770 msgr2=0xc3f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 shutdown_connections 2024-09-18T13:13:40.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.132+0000 7f4706842ec0 1 -- 172.21.15.120:0/3731423652 wait complete. 2024-09-18T13:13:40.135 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:40.135 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj9 /etc/passwd 2024-09-18T13:13:40.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.171+0000 7f076382fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.176+0000 7f076382fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.176+0000 7f076382fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.176+0000 7f076382fec0 1 Processor -- start 2024-09-18T13:13:40.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.176+0000 7f076382fec0 1 -- start start 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.177+0000 7f076382fec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x6edad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.177+0000 7f076382fec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x64e520 con 0x77c9b0 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0756ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x6edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0756ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x6edad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56502/0 (socket says 172.21.15.120:56502) 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0756ffd640 1 -- 172.21.15.120:0/1399745184 learned_addr learned my addr 172.21.15.120:0/1399745184 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0756ffd640 1 -- 172.21.15.120:0/1399745184 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5eae10 con 0x77c9b0 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0756ffd640 1 --2- 172.21.15.120:0/1399745184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x6edad0 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24656149661722bb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0755ffb640 1 -- 172.21.15.120:0/1399745184 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f074802db60 con 0x77c9b0 2024-09-18T13:13:40.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0755ffb640 1 -- 172.21.15.120:0/1399745184 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0748037370 con 0x77c9b0 2024-09-18T13:13:40.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.178+0000 7f0755ffb640 1 -- 172.21.15.120:0/1399745184 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0748037610 con 0x77c9b0 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 -- 172.21.15.120:0/1399745184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 msgr2=0x6edad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 --2- 172.21.15.120:0/1399745184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x6edad0 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 -- 172.21.15.120:0/1399745184 shutdown_connections 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 --2- 172.21.15.120:0/1399745184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x6edad0 unknown :-1 s=CLOSED pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 -- 172.21.15.120:0/1399745184 >> 172.21.15.120:0/1399745184 conn(0x60e770 msgr2=0x6e61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 -- 172.21.15.120:0/1399745184 shutdown_connections 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 -- 172.21.15.120:0/1399745184 wait complete. 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.179+0000 7f076382fec0 1 Processor -- start 2024-09-18T13:13:40.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.180+0000 7f076382fec0 1 -- start start 2024-09-18T13:13:40.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f076382fec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x77b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f076382fec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x64c280 con 0x77c9b0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0756ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x77b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0756ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x77b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56514/0 (socket says 172.21.15.120:56514) 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0756ffd640 1 -- 172.21.15.120:0/2606259473 learned_addr learned my addr 172.21.15.120:0/2606259473 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0756ffd640 1 -- 172.21.15.120:0/2606259473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5dc920 con 0x77c9b0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0756ffd640 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x77b430 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0754ff9640 1 -- 172.21.15.120:0/2606259473 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f074803f040 con 0x77c9b0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0754ff9640 1 -- 172.21.15.120:0/2606259473 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f074802da30 con 0x77c9b0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f0754ff9640 1 -- 172.21.15.120:0/2606259473 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0748037610 con 0x77c9b0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5dc380 con 0x77c9b0 2024-09-18T13:13:40.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.181+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x769290 con 0x77c9b0 2024-09-18T13:13:40.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.182+0000 7f0754ff9640 1 -- 172.21.15.120:0/2606259473 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0748039450 con 0x77c9b0 2024-09-18T13:13:40.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.182+0000 7f0754ff9640 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f073803d1c0 0x7f073803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.182+0000 7f0754ff9640 1 -- 172.21.15.120:0/2606259473 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7f0748032040 con 0x77c9b0 2024-09-18T13:13:40.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.183+0000 7f076382fec0 1 --2- 172.21.15.120:0/2606259473 >> v2:172.21.15.176:6806/2606993558 conn(0x77d300 0x767f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.183+0000 7f074ffff640 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f073803d1c0 0x7f073803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.183+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x76b950 con 0x77d300 2024-09-18T13:13:40.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.183+0000 7f074ffff640 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f073803d1c0 0x7f073803f6d0 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.183+0000 7f07577fe640 1 --2- 172.21.15.120:0/2606259473 >> v2:172.21.15.176:6806/2606993558 conn(0x77d300 0x767f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:40.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.186+0000 7f07577fe640 1 --2- 172.21.15.120:0/2606259473 >> v2:172.21.15.176:6806/2606993558 conn(0x77d300 0x767f90 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f07577fe640 1 -- 172.21.15.120:0/2606259473 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v697'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f075000a430 con 0x77d300 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 >> v2:172.21.15.176:6806/2606993558 conn(0x77d300 msgr2=0x767f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 --2- 172.21.15.120:0/2606259473 >> v2:172.21.15.176:6806/2606993558 conn(0x77d300 0x767f90 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f073803d1c0 msgr2=0x7f073803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f073803d1c0 0x7f073803f6d0 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 msgr2=0x77b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x77b430 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 shutdown_connections 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 --2- 172.21.15.120:0/2606259473 >> v2:172.21.15.176:6806/2606993558 conn(0x77d300 0x767f90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f073803d1c0 0x7f073803f6d0 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 --2- 172.21.15.120:0/2606259473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x77c9b0 0x77b430 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 >> 172.21.15.120:0/2606259473 conn(0x60e770 msgr2=0x6e7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 shutdown_connections 2024-09-18T13:13:40.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.199+0000 7f076382fec0 1 -- 172.21.15.120:0/2606259473 wait complete. 2024-09-18T13:13:40.202 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:13:40.202 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put obj10 /etc/passwd 2024-09-18T13:13:40.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.236+0000 7fdf3303aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.241+0000 7fdf3303aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.241+0000 7fdf3303aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:13:40.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.242+0000 7fdf3303aec0 1 Processor -- start 2024-09-18T13:13:40.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.242+0000 7fdf3303aec0 1 -- start start 2024-09-18T13:13:40.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf3303aec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1b51ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf3303aec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1ab2520 con 0x1be09b0 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf2b19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1b51ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf2b19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1b51ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56528/0 (socket says 172.21.15.120:56528) 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf2b19b640 1 -- 172.21.15.120:0/1231162520 learned_addr learned my addr 172.21.15.120:0/1231162520 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf2b19b640 1 -- 172.21.15.120:0/1231162520 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a4ee10 con 0x1be09b0 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf2b19b640 1 --2- 172.21.15.120:0/1231162520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1b51ad0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793c92708a73aa9f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.243+0000 7fdf29998640 1 -- 172.21.15.120:0/1231162520 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf1402dc20 con 0x1be09b0 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf29998640 1 -- 172.21.15.120:0/1231162520 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf14037370 con 0x1be09b0 2024-09-18T13:13:40.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf29998640 1 -- 172.21.15.120:0/1231162520 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf14037610 con 0x1be09b0 2024-09-18T13:13:40.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf3303aec0 1 -- 172.21.15.120:0/1231162520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 msgr2=0x1b51ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/1231162520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1b51ad0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf3303aec0 1 -- 172.21.15.120:0/1231162520 shutdown_connections 2024-09-18T13:13:40.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/1231162520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1b51ad0 unknown :-1 s=CLOSED pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf3303aec0 1 -- 172.21.15.120:0/1231162520 >> 172.21.15.120:0/1231162520 conn(0x1a72770 msgr2=0x1b4a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf3303aec0 1 -- 172.21.15.120:0/1231162520 shutdown_connections 2024-09-18T13:13:40.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.244+0000 7fdf3303aec0 1 -- 172.21.15.120:0/1231162520 wait complete. 2024-09-18T13:13:40.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.245+0000 7fdf3303aec0 1 Processor -- start 2024-09-18T13:13:40.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.245+0000 7fdf3303aec0 1 -- start start 2024-09-18T13:13:40.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.246+0000 7fdf3303aec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1c757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.246+0000 7fdf3303aec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1ab0280 con 0x1be09b0 2024-09-18T13:13:40.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.246+0000 7fdf2b19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1c757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.246+0000 7fdf2b19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1c757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56530/0 (socket says 172.21.15.120:56530) 2024-09-18T13:13:40.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.246+0000 7fdf2b19b640 1 -- 172.21.15.120:0/2420349824 learned_addr learned my addr 172.21.15.120:0/2420349824 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:13:40.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.246+0000 7fdf2b19b640 1 -- 172.21.15.120:0/2420349824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a40920 con 0x1be09b0 2024-09-18T13:13:40.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.246+0000 7fdf2b19b640 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1c757d0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.247+0000 7fdf28996640 1 -- 172.21.15.120:0/2420349824 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf1403f040 con 0x1be09b0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.247+0000 7fdf28996640 1 -- 172.21.15.120:0/2420349824 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf14037bb0 con 0x1be09b0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.247+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1a40380 con 0x1be09b0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.247+0000 7fdf28996640 1 -- 172.21.15.120:0/2420349824 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf14037e50 con 0x1be09b0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.247+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1bcc410 con 0x1be09b0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.248+0000 7fdf28996640 1 -- 172.21.15.120:0/2420349824 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fdf14039450 con 0x1be09b0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.248+0000 7fdf28996640 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdf1003d1c0 0x7fdf1003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.248+0000 7fdf28996640 1 -- 172.21.15.120:0/2420349824 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7fdf14032040 con 0x1be09b0 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.248+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/2420349824 >> v2:172.21.15.176:6806/2606993558 conn(0x1be1300 0x1bdf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.248+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1bcf300 con 0x1be1300 2024-09-18T13:13:40.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.248+0000 7fdf2a99a640 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdf1003d1c0 0x7fdf1003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:40.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.249+0000 7fdf2a99a640 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdf1003d1c0 0x7fdf1003f6d0 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.249+0000 7fdf2b99c640 1 --2- 172.21.15.120:0/2420349824 >> v2:172.21.15.176:6806/2606993558 conn(0x1be1300 0x1bdf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:13:40.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.253+0000 7fdf2b99c640 1 --2- 172.21.15.120:0/2420349824 >> v2:172.21.15.176:6806/2606993558 conn(0x1be1300 0x1bdf4a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf2b99c640 1 -- 172.21.15.120:0/2420349824 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fdf1c00a430 con 0x1be1300 2024-09-18T13:13:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 >> v2:172.21.15.176:6806/2606993558 conn(0x1be1300 msgr2=0x1bdf4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/2420349824 >> v2:172.21.15.176:6806/2606993558 conn(0x1be1300 0x1bdf4a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdf1003d1c0 msgr2=0x7fdf1003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdf1003d1c0 0x7fdf1003f6d0 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 msgr2=0x1c757d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1c757d0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 shutdown_connections 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/2420349824 >> v2:172.21.15.176:6806/2606993558 conn(0x1be1300 0x1bdf4a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fdf1003d1c0 0x7fdf1003f6d0 unknown :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 --2- 172.21.15.120:0/2420349824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1be09b0 0x1c757d0 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 >> 172.21.15.120:0/2420349824 conn(0x1a72770 msgr2=0x1b4bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 shutdown_connections 2024-09-18T13:13:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:13:40.265+0000 7fdf3303aec0 1 -- 172.21.15.120:0/2420349824 wait complete. 2024-09-18T13:13:40.269 INFO:tasks.workunit.client.0.smithi120.stderr:+ sleep 30 2024-09-18T13:14:10.271 INFO:tasks.workunit.client.0.smithi120.stderr:+ pid=96449 2024-09-18T13:14:10.272 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota 247c8d9d-0676-4971-be17-81eba57b92bd max_objects 100 2024-09-18T13:14:10.272 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put onemore /etc/passwd 2024-09-18T13:14:10.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.313+0000 7f0ec76e6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:10.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.320+0000 7f0ec76e6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:10.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.320+0000 7f0ec76e6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:10.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.321+0000 7f0ec76e6ec0 1 Processor -- start 2024-09-18T13:14:10.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.321+0000 7f0ec76e6ec0 1 -- start start 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.322+0000 7f0ec76e6ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xf1d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.322+0000 7f0ec76e6ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xe04520 con 0xf329b0 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.322+0000 7f0ebaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xf1d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.322+0000 7f0ebaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xf1d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53104/0 (socket says 172.21.15.120:53104) 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.322+0000 7f0ebaffd640 1 -- 172.21.15.120:0/1624100456 learned_addr learned my addr 172.21.15.120:0/1624100456 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.323+0000 7f0ebaffd640 1 -- 172.21.15.120:0/1624100456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xda0e10 con 0xf329b0 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.323+0000 7f0ebaffd640 1 --2- 172.21.15.120:0/1624100456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xf1d850 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7a603da6a09d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.323+0000 7f0eb97fa640 1 -- 172.21.15.120:0/1624100456 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0eac02da60 con 0xf329b0 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.323+0000 7f0eb97fa640 1 -- 172.21.15.120:0/1624100456 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0eac037370 con 0xf329b0 2024-09-18T13:14:10.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.323+0000 7f0eb97fa640 1 -- 172.21.15.120:0/1624100456 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0eac037610 con 0xf329b0 2024-09-18T13:14:10.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.324+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/1624100456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 msgr2=0xf1d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:10.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.324+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/1624100456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xf1d850 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.324+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/1624100456 shutdown_connections 2024-09-18T13:14:10.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.324+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/1624100456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xf1d850 unknown :-1 s=CLOSED pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.324+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/1624100456 >> 172.21.15.120:0/1624100456 conn(0xdc4770 msgr2=0xe9d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:10.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.324+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/1624100456 shutdown_connections 2024-09-18T13:14:10.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.324+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/1624100456 wait complete. 2024-09-18T13:14:10.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.325+0000 7f0ec76e6ec0 1 Processor -- start 2024-09-18T13:14:10.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.325+0000 7f0ec76e6ec0 1 -- start start 2024-09-18T13:14:10.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.326+0000 7f0ec76e6ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xfc79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:10.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.326+0000 7f0ec76e6ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xe02280 con 0xf329b0 2024-09-18T13:14:10.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.326+0000 7f0ebaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xfc79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:10.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.326+0000 7f0ebaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xfc79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53108/0 (socket says 172.21.15.120:53108) 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.326+0000 7f0ebaffd640 1 -- 172.21.15.120:0/3788639980 learned_addr learned my addr 172.21.15.120:0/3788639980 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.327+0000 7f0ebaffd640 1 -- 172.21.15.120:0/3788639980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd92920 con 0xf329b0 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.327+0000 7f0ebaffd640 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xfc79d0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.327+0000 7f0ea3fff640 1 -- 172.21.15.120:0/3788639980 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0eac0377c0 con 0xf329b0 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.327+0000 7f0ea3fff640 1 -- 172.21.15.120:0/3788639980 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0eac037920 con 0xf329b0 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.327+0000 7f0ea3fff640 1 -- 172.21.15.120:0/3788639980 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0eac037bc0 con 0xf329b0 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.327+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd92380 con 0xf329b0 2024-09-18T13:14:10.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.327+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf22bf0 con 0xf329b0 2024-09-18T13:14:10.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.328+0000 7f0ea3fff640 1 -- 172.21.15.120:0/3788639980 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0eac037d70 con 0xf329b0 2024-09-18T13:14:10.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.329+0000 7f0ea3fff640 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0ea803d1c0 0x7f0ea803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:10.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.329+0000 7f0ea3fff640 1 -- 172.21.15.120:0/3788639980 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7f0eac032040 con 0xf329b0 2024-09-18T13:14:10.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.329+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/3788639980 >> v2:172.21.15.120:6801/1764758402 conn(0xf33300 0xf21250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:10.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.329+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0xf24420 con 0xf33300 2024-09-18T13:14:10.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.329+0000 7f0eba7fc640 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0ea803d1c0 0x7f0ea803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:10.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.330+0000 7f0eba7fc640 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0ea803d1c0 0x7f0ea803f6d0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:10.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.330+0000 7f0ebb7fe640 1 --2- 172.21.15.120:0/3788639980 >> v2:172.21.15.120:6801/1764758402 conn(0xf33300 0xf21250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:14:10.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.333+0000 7f0ebb7fe640 1 --2- 172.21.15.120:0/3788639980 >> v2:172.21.15.120:6801/1764758402 conn(0xf33300 0xf21250 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.348+0000 7f0ebb7fe640 1 -- 172.21.15.120:0/3788639980 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 onemore [writefull 0~12875] v697'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f0eb400a430 con 0xf33300 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.348+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 >> v2:172.21.15.120:6801/1764758402 conn(0xf33300 msgr2=0xf21250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.348+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/3788639980 >> v2:172.21.15.120:6801/1764758402 conn(0xf33300 0xf21250 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.348+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0ea803d1c0 msgr2=0x7f0ea803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.348+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0ea803d1c0 0x7f0ea803f6d0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 msgr2=0xfc79d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xfc79d0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 shutdown_connections 2024-09-18T13:14:10.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/3788639980 >> v2:172.21.15.120:6801/1764758402 conn(0xf33300 0xf21250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0ea803d1c0 0x7f0ea803f6d0 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 --2- 172.21.15.120:0/3788639980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf329b0 0xfc79d0 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 >> 172.21.15.120:0/3788639980 conn(0xdc4770 msgr2=0xe9d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:10.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 shutdown_connections 2024-09-18T13:14:10.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.349+0000 7f0ec76e6ec0 1 -- 172.21.15.120:0/3788639980 wait complete. 2024-09-18T13:14:10.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.369+0000 7f7d5089c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:10.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.379+0000 7f7d5089c640 1 Processor -- start 2024-09-18T13:14:10.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.379+0000 7f7d5089c640 1 -- start start 2024-09-18T13:14:10.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.380+0000 7f7d5089c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7d4c132f70 0x7f7d4c133380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:10.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.380+0000 7f7d5089c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d4c0a08a0 con 0x7f7d4c1338c0 2024-09-18T13:14:10.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.380+0000 7f7d5089c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4c09e990 con 0x7f7d4c132f70 2024-09-18T13:14:10.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4a59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7d4c132f70 0x7f7d4c133380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:10.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d49d9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7d4c1338c0 0x7f7d4c06e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49920/0 (socket says 172.21.15.120:49920) 2024-09-18T13:14:10.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d49d9b640 1 -- 172.21.15.120:0/2451631588 learned_addr learned my addr 172.21.15.120:0/2451631588 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:14:10.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4a59c640 1 -- 172.21.15.120:0/2451631588 >> v1:172.21.15.120:6789/0 conn(0x7f7d4c1338c0 legacy=0x7f7d4c06e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:10.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4959a640 1 -- 172.21.15.120:0/2451631588 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165485136 0 0) 0x7f7d4c0a08a0 con 0x7f7d4c1338c0 2024-09-18T13:14:10.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4a59c640 1 -- 172.21.15.120:0/2451631588 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c09ee10 con 0x7f7d4c132f70 2024-09-18T13:14:10.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4a59c640 1 --2- 172.21.15.120:0/2451631588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c133380 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3f3f2e259dd31e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:10.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4959a640 1 -- 172.21.15.120:0/2451631588 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d3c00e040 con 0x7f7d4c132f70 2024-09-18T13:14:10.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4959a640 1 -- 172.21.15.120:0/2451631588 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7d3c007670 con 0x7f7d4c132f70 2024-09-18T13:14:10.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.381+0000 7f7d4959a640 1 -- 172.21.15.120:0/2451631588 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d3c007910 con 0x7f7d4c132f70 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 1 -- 172.21.15.120:0/2451631588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 msgr2=0x7f7d4c133380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 1 --2- 172.21.15.120:0/2451631588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c133380 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 1 -- 172.21.15.120:0/2451631588 shutdown_connections 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 1 --2- 172.21.15.120:0/2451631588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c133380 unknown :-1 s=CLOSED pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 1 -- 172.21.15.120:0/2451631588 >> 172.21.15.120:0/2451631588 conn(0x7f7d4c09d9e0 msgr2=0x7f7d4c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 1 -- 172.21.15.120:0/2451631588 shutdown_connections 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 1 -- 172.21.15.120:0/2451631588 wait complete. 2024-09-18T13:14:10.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.382+0000 7f7d5089c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:10.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.384+0000 7f7d5089c640 1 Processor -- start 2024-09-18T13:14:10.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.384+0000 7f7d5089c640 1 -- start start 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.385+0000 7f7d5089c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.385+0000 7f7d5089c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c123f40 con 0x7f7d4c132f70 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.385+0000 7f7d4a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.385+0000 7f7d4a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c122c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53120/0 (socket says 172.21.15.120:53120) 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.385+0000 7f7d4a59c640 1 -- 172.21.15.120:0/4148594107 learned_addr learned my addr 172.21.15.120:0/4148594107 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.385+0000 7f7d4a59c640 1 -- 172.21.15.120:0/4148594107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c132db0 con 0x7f7d4c132f70 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.385+0000 7f7d4a59c640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c122c00 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.386+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d3c00e040 con 0x7f7d4c132f70 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.386+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7d3c013ad0 con 0x7f7d4c132f70 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.386+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4c126be0 con 0x7f7d4c132f70 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.386+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d3c013d70 con 0x7f7d4c132f70 2024-09-18T13:14:10.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.386+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4c073690 con 0x7f7d4c132f70 2024-09-18T13:14:10.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.387+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c0a1e90 con 0x7f7d4c132f70 2024-09-18T13:14:10.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.387+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7d3c011040 con 0x7f7d4c132f70 2024-09-18T13:14:10.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.387+0000 7f7d3affd640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7d2c03e930 0x7f7d2c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:10.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.387+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(697..697 src has 408..697) ==== 3819+0+0 (crc 0 0 0) 0x7f7d3c051420 con 0x7f7d4c132f70 2024-09-18T13:14:10.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.387+0000 7f7d49d9b640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7d2c03e930 0x7f7d2c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:10.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.388+0000 7f7d49d9b640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7d2c03e930 0x7f7d2c040e40 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:10.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.392+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f7d3c015580 con 0x7f7d4c132f70 2024-09-18T13:14:10.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:10.585+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "100"} v 0) -- 0x7f7d4c076080 con 0x7f7d4c132f70 2024-09-18T13:14:11.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:11.469+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v699) ==== 225+0+0 (crc 0 0 0) 0x7f7d3c00f210 con 0x7f7d4c132f70 2024-09-18T13:14:11.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:11.604+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "100"} v 0) -- 0x7f7d4c1254a0 con 0x7f7d4c132f70 2024-09-18T13:14:12.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.470+0000 7f7d3affd640 1 -- 172.21.15.120:0/4148594107 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v700) ==== 225+0+0 (crc 0 0 0) 0x7f7d3c00f3f0 con 0x7f7d4c132f70 2024-09-18T13:14:12.471 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_objects = 100 for pool 247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:14:12.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7d2c03e930 msgr2=0x7f7d2c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:12.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7d2c03e930 0x7f7d2c040e40 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:12.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 msgr2=0x7f7d4c122c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:12.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c122c00 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:12.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 shutdown_connections 2024-09-18T13:14:12.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f7d2c03e930 0x7f7d2c040e40 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:12.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 --2- 172.21.15.120:0/4148594107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d4c132f70 0x7f7d4c122c00 unknown :-1 s=CLOSED pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:12.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 >> 172.21.15.120:0/4148594107 conn(0x7f7d4c09d9e0 msgr2=0x7f7d4c0a2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:12.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 shutdown_connections 2024-09-18T13:14:12.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.474+0000 7f7d5089c640 1 -- 172.21.15.120:0/4148594107 wait complete. 2024-09-18T13:14:12.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ wait 96449 2024-09-18T13:14:12.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -ne 0 ']' 2024-09-18T13:14:12.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ true 2024-09-18T13:14:12.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put twomore /etc/passwd 2024-09-18T13:14:12.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.530+0000 7fb827aedec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:12.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.535+0000 7fb827aedec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:12.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.535+0000 7fb827aedec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:12.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.536+0000 7fb827aedec0 1 Processor -- start 2024-09-18T13:14:12.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.536+0000 7fb827aedec0 1 -- start start 2024-09-18T13:14:12.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.537+0000 7fb827aedec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x124f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:12.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.537+0000 7fb827aedec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x11b7520 con 0x1253300 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.537+0000 7fb81affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x124f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.537+0000 7fb81affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x124f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53136/0 (socket says 172.21.15.120:53136) 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.537+0000 7fb81affd640 1 -- 172.21.15.120:0/1924025762 learned_addr learned my addr 172.21.15.120:0/1924025762 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.537+0000 7fb81affd640 1 -- 172.21.15.120:0/1924025762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1153e10 con 0x1253300 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.537+0000 7fb81affd640 1 --2- 172.21.15.120:0/1924025762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x124f710 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0ada5a3ce0d4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb8197fa640 1 -- 172.21.15.120:0/1924025762 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb80c02db60 con 0x1253300 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb8197fa640 1 -- 172.21.15.120:0/1924025762 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb80c00a040 con 0x1253300 2024-09-18T13:14:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb8197fa640 1 -- 172.21.15.120:0/1924025762 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb80c00a1b0 con 0x1253300 2024-09-18T13:14:12.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb827aedec0 1 -- 172.21.15.120:0/1924025762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 msgr2=0x124f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:12.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb827aedec0 1 --2- 172.21.15.120:0/1924025762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x124f710 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:12.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb827aedec0 1 -- 172.21.15.120:0/1924025762 shutdown_connections 2024-09-18T13:14:12.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb827aedec0 1 --2- 172.21.15.120:0/1924025762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x124f710 unknown :-1 s=CLOSED pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:12.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb827aedec0 1 -- 172.21.15.120:0/1924025762 >> 172.21.15.120:0/1924025762 conn(0x1177770 msgr2=0x12e2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:12.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb827aedec0 1 -- 172.21.15.120:0/1924025762 shutdown_connections 2024-09-18T13:14:12.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.538+0000 7fb827aedec0 1 -- 172.21.15.120:0/1924025762 wait complete. 2024-09-18T13:14:12.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.539+0000 7fb827aedec0 1 Processor -- start 2024-09-18T13:14:12.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.539+0000 7fb827aedec0 1 -- start start 2024-09-18T13:14:12.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.540+0000 7fb827aedec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x12d0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:12.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.540+0000 7fb827aedec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x11b5280 con 0x1253300 2024-09-18T13:14:12.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.540+0000 7fb81affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x12d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:12.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.540+0000 7fb81affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x12d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53152/0 (socket says 172.21.15.120:53152) 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.540+0000 7fb81affd640 1 -- 172.21.15.120:0/3308710419 learned_addr learned my addr 172.21.15.120:0/3308710419 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.540+0000 7fb81affd640 1 -- 172.21.15.120:0/3308710419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1145920 con 0x1253300 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.541+0000 7fb81affd640 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x12d0440 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.541+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb80c03e040 con 0x1253300 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.541+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb80c00a1b0 con 0x1253300 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.541+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1145380 con 0x1253300 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.541+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb80c02dc90 con 0x1253300 2024-09-18T13:14:12.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.541+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x12d1d20 con 0x1253300 2024-09-18T13:14:12.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.542+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb80c041040 con 0x1253300 2024-09-18T13:14:12.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.542+0000 7fb803fff640 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb80803d1c0 0x7fb80803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:12.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.542+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(700..700 src has 408..700) ==== 3819+0+0 (crc 0 0 0) 0x7fb80c032040 con 0x1253300 2024-09-18T13:14:12.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.542+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7fb808043450 con 0x1253300 2024-09-18T13:14:12.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.542+0000 7fb827aedec0 1 --2- 172.21.15.120:0/3308710419 >> v2:172.21.15.120:6801/1764758402 conn(0x1253c50 0x177c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:12.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.542+0000 7fb81a7fc640 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb80803d1c0 0x7fb80803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:12.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.543+0000 7fb81a7fc640 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb80803d1c0 0x7fb80803f6d0 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:12.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.543+0000 7fb81b7fe640 1 --2- 172.21.15.120:0/3308710419 >> v2:172.21.15.120:6801/1764758402 conn(0x1253c50 0x177c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:14:12.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:12.547+0000 7fb81b7fe640 1 --2- 172.21.15.120:0/3308710419 >> v2:172.21.15.120:6801/1764758402 conn(0x1253c50 0x177c830 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:15.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.463+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 <== mon.0 v2:172.21.15.120:3300/0 6 ==== osd_map(701..701 src has 408..701) ==== 628+0+0 (crc 0 0 0) 0x7fb80c02de40 con 0x1253300 2024-09-18T13:14:15.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.463+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7fb808043b90 con 0x1253300 2024-09-18T13:14:15.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.463+0000 7fb803fff640 1 -- 172.21.15.120:0/3308710419 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e701) -- 0x7fb808043e10 con 0x1253c50 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.505+0000 7fb81b7fe640 1 -- 172.21.15.120:0/3308710419 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 twomore [writefull 0~12875] v701'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7fb81400a430 con 0x1253c50 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.505+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 >> v2:172.21.15.120:6801/1764758402 conn(0x1253c50 msgr2=0x177c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.505+0000 7fb827aedec0 1 --2- 172.21.15.120:0/3308710419 >> v2:172.21.15.120:6801/1764758402 conn(0x1253c50 0x177c830 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb80803d1c0 msgr2=0x7fb80803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb80803d1c0 0x7fb80803f6d0 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 msgr2=0x12d0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x12d0440 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 shutdown_connections 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 --2- 172.21.15.120:0/3308710419 >> v2:172.21.15.120:6801/1764758402 conn(0x1253c50 0x177c830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fb80803d1c0 0x7fb80803f6d0 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 --2- 172.21.15.120:0/3308710419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1253300 0x12d0440 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 >> 172.21.15.120:0/3308710419 conn(0x1177770 msgr2=0x12e2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:15.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 shutdown_connections 2024-09-18T13:14:15.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.506+0000 7fb827aedec0 1 -- 172.21.15.120:0/3308710419 wait complete. 2024-09-18T13:14:15.510 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota 247c8d9d-0676-4971-be17-81eba57b92bd max_bytes 100 2024-09-18T13:14:15.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.594+0000 7f683444f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:15.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.604+0000 7f683444f640 1 Processor -- start 2024-09-18T13:14:15.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.604+0000 7f683444f640 1 -- start start 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f683444f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f682c1393c0 0x7f682c13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f683444f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f682c06dd50 con 0x7f682c06e6e0 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f68321eb640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f682c06e6e0 0x7f682c06eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49936/0 (socket says 172.21.15.120:49936) 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f683444f640 1 -- 172.21.15.120:0/3901877312 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f682c06f200 con 0x7f682c1393c0 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f68321eb640 1 -- 172.21.15.120:0/3901877312 learned_addr learned my addr 172.21.15.120:0/3901877312 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f68319ea640 1 --2- 172.21.15.120:0/3901877312 >> v2:172.21.15.120:3300/0 conn(0x7f682c1393c0 0x7f682c13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f68311e9640 1 -- 172.21.15.120:0/3901877312 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948425983 0 0) 0x7f682c06dd50 con 0x7f682c06e6e0 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.605+0000 7f68311e9640 1 -- 172.21.15.120:0/3901877312 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6818003580 con 0x7f682c06e6e0 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.606+0000 7f68319ea640 1 -- 172.21.15.120:0/3901877312 >> v1:172.21.15.120:6789/0 conn(0x7f682c06e6e0 legacy=0x7f682c06eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.606+0000 7f68319ea640 1 -- 172.21.15.120:0/3901877312 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c06f590 con 0x7f682c1393c0 2024-09-18T13:14:15.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.606+0000 7f68319ea640 1 --2- 172.21.15.120:0/3901877312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c1393c0 0x7f682c13b7e0 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224626d8ce28aa89 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:15.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.606+0000 7f68311e9640 1 -- 172.21.15.120:0/3901877312 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f681c009d80 con 0x7f682c1393c0 2024-09-18T13:14:15.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.606+0000 7f68311e9640 1 -- 172.21.15.120:0/3901877312 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f681c00e230 con 0x7f682c1393c0 2024-09-18T13:14:15.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.606+0000 7f68311e9640 1 -- 172.21.15.120:0/3901877312 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f681c00e4d0 con 0x7f682c1393c0 2024-09-18T13:14:15.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 1 -- 172.21.15.120:0/3901877312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c1393c0 msgr2=0x7f682c13b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 1 --2- 172.21.15.120:0/3901877312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c1393c0 0x7f682c13b7e0 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 1 -- 172.21.15.120:0/3901877312 shutdown_connections 2024-09-18T13:14:15.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 1 --2- 172.21.15.120:0/3901877312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c1393c0 0x7f682c13b7e0 unknown :-1 s=CLOSED pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 1 -- 172.21.15.120:0/3901877312 >> 172.21.15.120:0/3901877312 conn(0x7f682c0a31b0 msgr2=0x7f682c0a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:15.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 1 -- 172.21.15.120:0/3901877312 shutdown_connections 2024-09-18T13:14:15.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 1 -- 172.21.15.120:0/3901877312 wait complete. 2024-09-18T13:14:15.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.607+0000 7f683444f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:15.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.608+0000 7f683444f640 1 Processor -- start 2024-09-18T13:14:15.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.608+0000 7f683444f640 1 -- start start 2024-09-18T13:14:15.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.609+0000 7f683444f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c06e6e0 0x7f682c1caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:15.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.609+0000 7f683444f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f682c122d90 con 0x7f682c06e6e0 2024-09-18T13:14:15.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.609+0000 7f68321eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c06e6e0 0x7f682c1caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:15.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.609+0000 7f68321eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c06e6e0 0x7f682c1caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53158/0 (socket says 172.21.15.120:53158) 2024-09-18T13:14:15.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f68321eb640 1 -- 172.21.15.120:0/3027017868 learned_addr learned my addr 172.21.15.120:0/3027017868 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:15.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f68321eb640 1 -- 172.21.15.120:0/3027017868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c120cd0 con 0x7f682c06e6e0 2024-09-18T13:14:15.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f68321eb640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c06e6e0 0x7f682c1caa00 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:15.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6828005a60 con 0x7f682c06e6e0 2024-09-18T13:14:15.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6828005bc0 con 0x7f682c06e6e0 2024-09-18T13:14:15.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6828005e60 con 0x7f682c06e6e0 2024-09-18T13:14:15.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682c122370 con 0x7f682c06e6e0 2024-09-18T13:14:15.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.610+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682c120930 con 0x7f682c06e6e0 2024-09-18T13:14:15.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.611+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f68280070b0 con 0x7f682c06e6e0 2024-09-18T13:14:15.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.611+0000 7f6822ffd640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681003e910 0x7f6810040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:15.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.611+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682c06fe30 con 0x7f682c06e6e0 2024-09-18T13:14:15.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.611+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(701..701 src has 408..701) ==== 3819+0+0 (crc 0 0 0) 0x7f682804fb60 con 0x7f682c06e6e0 2024-09-18T13:14:15.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.612+0000 7f68319ea640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681003e910 0x7f6810040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:15.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.612+0000 7f68319ea640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681003e910 0x7f6810040e20 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:15.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.617+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f682800f230 con 0x7f682c06e6e0 2024-09-18T13:14:15.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:15.793+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "100"} v 0) -- 0x7f682c06a450 con 0x7f682c06e6e0 2024-09-18T13:14:16.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:16.463+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v702) ==== 221+0+0 (crc 0 0 0) 0x7f6828021040 con 0x7f682c06e6e0 2024-09-18T13:14:16.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:16.593+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "100"} v 0) -- 0x7f682c123d10 con 0x7f682c06e6e0 2024-09-18T13:14:17.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.468+0000 7f6822ffd640 1 -- 172.21.15.120:0/3027017868 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v703) ==== 221+0+0 (crc 0 0 0) 0x7f6828021040 con 0x7f682c06e6e0 2024-09-18T13:14:17.469 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_bytes = 100 for pool 247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:14:17.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681003e910 msgr2=0x7f6810040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:17.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681003e910 0x7f6810040e20 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c06e6e0 msgr2=0x7f682c1caa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:17.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c06e6e0 0x7f682c1caa00 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 shutdown_connections 2024-09-18T13:14:17.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681003e910 0x7f6810040e20 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 --2- 172.21.15.120:0/3027017868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f682c06e6e0 0x7f682c1caa00 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.471+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 >> 172.21.15.120:0/3027017868 conn(0x7f682c0a31b0 msgr2=0x7f682c137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:17.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.472+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 shutdown_connections 2024-09-18T13:14:17.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:17.472+0000 7f683444f640 1 -- 172.21.15.120:0/3027017868 wait complete. 2024-09-18T13:14:17.487 INFO:tasks.workunit.client.0.smithi120.stderr:+ sleep 30 2024-09-18T13:14:47.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ pid=96541 2024-09-18T13:14:47.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota 247c8d9d-0676-4971-be17-81eba57b92bd max_bytes 0 2024-09-18T13:14:47.490 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put two /etc/passwd 2024-09-18T13:14:47.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.531+0000 7f766c131ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:47.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.537+0000 7f766c131ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:47.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.537+0000 7f766c131ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:47.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.538+0000 7f766c131ec0 1 Processor -- start 2024-09-18T13:14:47.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.538+0000 7f766c131ec0 1 -- start start 2024-09-18T13:14:47.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.539+0000 7f766c131ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x1fb4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.539+0000 7f766c131ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1f33520 con 0x1fc6fc0 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.539+0000 7f7664a3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x1fb4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.539+0000 7f7664a3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x1fb4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60594/0 (socket says 172.21.15.120:60594) 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.539+0000 7f7664a3f640 1 -- 172.21.15.120:0/2784948772 learned_addr learned my addr 172.21.15.120:0/2784948772 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.539+0000 7f7664a3f640 1 -- 172.21.15.120:0/2784948772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1ecfe10 con 0x1fc6fc0 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.540+0000 7f7664a3f640 1 --2- 172.21.15.120:0/2784948772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x1fb4d80 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d8279298bc2053 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.540+0000 7f765e7fc640 1 -- 172.21.15.120:0/2784948772 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f765002dc90 con 0x1fc6fc0 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.540+0000 7f765e7fc640 1 -- 172.21.15.120:0/2784948772 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f765000a040 con 0x1fc6fc0 2024-09-18T13:14:47.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.540+0000 7f765e7fc640 1 -- 172.21.15.120:0/2784948772 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f765000a2e0 con 0x1fc6fc0 2024-09-18T13:14:47.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.541+0000 7f766c131ec0 1 -- 172.21.15.120:0/2784948772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 msgr2=0x1fb4d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:47.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.541+0000 7f766c131ec0 1 --2- 172.21.15.120:0/2784948772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x1fb4d80 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:47.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.541+0000 7f766c131ec0 1 -- 172.21.15.120:0/2784948772 shutdown_connections 2024-09-18T13:14:47.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.541+0000 7f766c131ec0 1 --2- 172.21.15.120:0/2784948772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x1fb4d80 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:47.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.541+0000 7f766c131ec0 1 -- 172.21.15.120:0/2784948772 >> 172.21.15.120:0/2784948772 conn(0x1ef3770 msgr2=0x1fcbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:47.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.541+0000 7f766c131ec0 1 -- 172.21.15.120:0/2784948772 shutdown_connections 2024-09-18T13:14:47.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.541+0000 7f766c131ec0 1 -- 172.21.15.120:0/2784948772 wait complete. 2024-09-18T13:14:47.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.542+0000 7f766c131ec0 1 Processor -- start 2024-09-18T13:14:47.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.542+0000 7f766c131ec0 1 -- start start 2024-09-18T13:14:47.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.543+0000 7f766c131ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x20f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:47.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.543+0000 7f766c131ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1f31280 con 0x1fc6fc0 2024-09-18T13:14:47.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.543+0000 7f7664a3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x20f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:47.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.543+0000 7f7664a3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x20f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60598/0 (socket says 172.21.15.120:60598) 2024-09-18T13:14:47.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.543+0000 7f7664a3f640 1 -- 172.21.15.120:0/1877941979 learned_addr learned my addr 172.21.15.120:0/1877941979 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:47.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.544+0000 7f7664a3f640 1 -- 172.21.15.120:0/1877941979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1ec1920 con 0x1fc6fc0 2024-09-18T13:14:47.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.544+0000 7f7664a3f640 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x20f6850 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:47.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.544+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f765003e040 con 0x1fc6fc0 2024-09-18T13:14:47.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.544+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f765002db60 con 0x1fc6fc0 2024-09-18T13:14:47.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.544+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7650009b90 con 0x1fc6fc0 2024-09-18T13:14:47.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.544+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1ec1380 con 0x1fc6fc0 2024-09-18T13:14:47.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.544+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20ecbb0 con 0x1fc6fc0 2024-09-18T13:14:47.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.545+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7650009d40 con 0x1fc6fc0 2024-09-18T13:14:47.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.546+0000 7f765d7fa640 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f764c03d170 0x7f764c03f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:47.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.546+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(705..705 src has 408..705) ==== 3819+0+0 (crc 0 0 0) 0x7f7650032040 con 0x1fc6fc0 2024-09-18T13:14:47.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.546+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f764c043400 con 0x1fc6fc0 2024-09-18T13:14:47.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.546+0000 7f766c131ec0 1 --2- 172.21.15.120:0/1877941979 >> v2:172.21.15.120:6801/1764758402 conn(0x1fcf130 0x20d3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:47.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.546+0000 7f765f7fe640 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f764c03d170 0x7f764c03f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:47.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.547+0000 7f765f7fe640 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f764c03d170 0x7f764c03f680 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:47.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.547+0000 7f7665240640 1 --2- 172.21.15.120:0/1877941979 >> v2:172.21.15.120:6801/1764758402 conn(0x1fcf130 0x20d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:14:47.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.551+0000 7f7665240640 1 --2- 172.21.15.120:0/1877941979 >> v2:172.21.15.120:6801/1764758402 conn(0x1fcf130 0x20d3770 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:47.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.583+0000 7f6f72391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:47.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.592+0000 7f6f72391640 1 Processor -- start 2024-09-18T13:14:47.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.592+0000 7f6f72391640 1 -- start start 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.593+0000 7f6f72391640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6f6c0a0290 0x7f6f6c0a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f72391640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c0a12e0 con 0x7f6f6c0a0be0 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f72391640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6c071790 con 0x7f6f6c0a0290 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6f6c0a0290 0x7f6f6c0a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6f6c0a0290 0x7f6f6c0a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60606/0 (socket says 172.21.15.120:60606) 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6bfff640 1 -- 172.21.15.120:0/292782654 learned_addr learned my addr 172.21.15.120:0/292782654 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6b7fe640 1 --1- 172.21.15.120:0/292782654 >> v1:172.21.15.120:6789/0 conn(0x7f6f6c0a0be0 0x7f6f6c133f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33338/0 (socket says 172.21.15.120:33338) 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6bfff640 1 -- 172.21.15.120:0/292782654 >> v1:172.21.15.120:6789/0 conn(0x7f6f6c0a0be0 legacy=0x7f6f6c133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6bfff640 1 -- 172.21.15.120:0/292782654 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c0a1c80 con 0x7f6f6c0a0290 2024-09-18T13:14:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6bfff640 1 --2- 172.21.15.120:0/292782654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c0a06a0 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a448aef22e8b1da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6affd640 1 -- 172.21.15.120:0/292782654 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f5c009e50 con 0x7f6f6c0a0290 2024-09-18T13:14:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6affd640 1 -- 172.21.15.120:0/292782654 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f5c00e230 con 0x7f6f6c0a0290 2024-09-18T13:14:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.594+0000 7f6f6affd640 1 -- 172.21.15.120:0/292782654 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f5c00e4d0 con 0x7f6f6c0a0290 2024-09-18T13:14:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 1 -- 172.21.15.120:0/292782654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 msgr2=0x7f6f6c0a06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 1 --2- 172.21.15.120:0/292782654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c0a06a0 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 1 -- 172.21.15.120:0/292782654 shutdown_connections 2024-09-18T13:14:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 1 --2- 172.21.15.120:0/292782654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c0a06a0 unknown :-1 s=CLOSED pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 1 -- 172.21.15.120:0/292782654 >> 172.21.15.120:0/292782654 conn(0x7f6f6c09d9e0 msgr2=0x7f6f6c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 1 -- 172.21.15.120:0/292782654 shutdown_connections 2024-09-18T13:14:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 1 -- 172.21.15.120:0/292782654 wait complete. 2024-09-18T13:14:47.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.595+0000 7f6f72391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:47.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.597+0000 7f6f72391640 1 Processor -- start 2024-09-18T13:14:47.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.597+0000 7f6f72391640 1 -- start start 2024-09-18T13:14:47.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.598+0000 7f6f72391640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c123c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:47.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.598+0000 7f6f72391640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c134e70 con 0x7f6f6c0a0290 2024-09-18T13:14:47.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.598+0000 7f6f6bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c123c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:47.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.598+0000 7f6f6bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c123c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60608/0 (socket says 172.21.15.120:60608) 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.598+0000 7f6f6bfff640 1 -- 172.21.15.120:0/3835229155 learned_addr learned my addr 172.21.15.120:0/3835229155 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.598+0000 7f6f6bfff640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c124f60 con 0x7f6f6c0a0290 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.599+0000 7f6f6bfff640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c123c20 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.599+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f5c00ee20 con 0x7f6f6c0a0290 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.599+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f5c015420 con 0x7f6f6c0a0290 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.599+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c0a2a60 con 0x7f6f6c0a0290 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.599+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f5c0156c0 con 0x7f6f6c0a0290 2024-09-18T13:14:47.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.599+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c1256a0 con 0x7f6f6c0a0290 2024-09-18T13:14:47.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.600+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6f5c015870 con 0x7f6f6c0a0290 2024-09-18T13:14:47.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.600+0000 7f6f68ff9640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6f5803e930 0x7f6f58040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:47.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.600+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6c125ed0 con 0x7f6f6c0a0290 2024-09-18T13:14:47.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.600+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(705..705 src has 408..705) ==== 3819+0+0 (crc 0 0 0) 0x7f6f5c0510a0 con 0x7f6f6c0a0290 2024-09-18T13:14:47.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.600+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f6f58044bc0 con 0x7f6f6c0a0290 2024-09-18T13:14:47.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.600+0000 7f6f6b7fe640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6f5803e930 0x7f6f58040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:47.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.601+0000 7f6f6b7fe640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6f5803e930 0x7f6f58040e40 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:47.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.605+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f6f5c014c60 con 0x7f6f6c0a0290 2024-09-18T13:14:47.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:47.782+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"} v 0) -- 0x7f6f6c0a20b0 con 0x7f6f6c0a0290 2024-09-18T13:14:48.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:48.471+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v706) ==== 217+0+0 (crc 0 0 0) 0x7f6f5c0059f0 con 0x7f6f6c0a0290 2024-09-18T13:14:48.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:48.474+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 6 ==== osd_map(706..706 src has 408..706) ==== 628+0+0 (crc 0 0 0) 0x7f765002de40 con 0x1fc6fc0 2024-09-18T13:14:48.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:48.474+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f764c043b40 con 0x1fc6fc0 2024-09-18T13:14:48.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:48.474+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(706..706 src has 408..706) ==== 628+0+0 (crc 0 0 0) 0x7f6f5c016040 con 0x7f6f6c0a0290 2024-09-18T13:14:48.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:48.474+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f6f58045b50 con 0x7f6f6c0a0290 2024-09-18T13:14:48.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:48.606+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"} v 0) -- 0x7f6f6c0008d0 con 0x7f6f6c0a0290 2024-09-18T13:14:49.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.486+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v707) ==== 217+0+0 (crc 0 0 0) 0x7f6f5c010310 con 0x7f6f6c0a0290 2024-09-18T13:14:49.488 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_bytes = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:14:49.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.487+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 <== mon.0 v2:172.21.15.120:3300/0 10 ==== osd_map(707..707 src has 408..707) ==== 628+0+0 (crc 0 0 0) 0x7f6f5c011e30 con 0x7f6f6c0a0290 2024-09-18T13:14:49.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.487+0000 7f6f68ff9640 1 -- 172.21.15.120:0/3835229155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f6f58045d40 con 0x7f6f6c0a0290 2024-09-18T13:14:49.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.487+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 7 ==== osd_map(707..707 src has 408..707) ==== 628+0+0 (crc 0 0 0) 0x7f7650035810 con 0x1fc6fc0 2024-09-18T13:14:49.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.487+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f764c043d60 con 0x1fc6fc0 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6f5803e930 msgr2=0x7f6f58040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6f5803e930 0x7f6f58040e40 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 msgr2=0x7f6f6c123c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c123c20 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 shutdown_connections 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6f5803e930 0x7f6f58040e40 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 --2- 172.21.15.120:0/3835229155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f6c0a0290 0x7f6f6c123c20 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.491+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 >> 172.21.15.120:0/3835229155 conn(0x7f6f6c09d9e0 msgr2=0x7f6f6c11ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.492+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 shutdown_connections 2024-09-18T13:14:49.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.492+0000 7f6f72391640 1 -- 172.21.15.120:0/3835229155 wait complete. 2024-09-18T13:14:49.510 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota 247c8d9d-0676-4971-be17-81eba57b92bd max_objects 0 2024-09-18T13:14:49.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.601+0000 7f0c8e263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:49.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.611+0000 7f0c8e263640 1 Processor -- start 2024-09-18T13:14:49.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.611+0000 7f0c8e263640 1 -- start start 2024-09-18T13:14:49.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.612+0000 7f0c8e263640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0c88073f60 0x7f0c8813c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:49.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.612+0000 7f0c8e263640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8809c9b0 con 0x7f0c8809e710 2024-09-18T13:14:49.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.612+0000 7f0c8e263640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8806e3b0 con 0x7f0c88073f60 2024-09-18T13:14:49.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.612+0000 7f0c7f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0c88073f60 0x7f0c8813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:49.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.612+0000 7f0c7f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0c88073f60 0x7f0c8813c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60620/0 (socket says 172.21.15.120:60620) 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.612+0000 7f0c87fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0c8809e710 0x7f0c88073850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33346/0 (socket says 172.21.15.120:33346) 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.612+0000 7f0c7f7fe640 1 -- 172.21.15.120:0/2665084531 learned_addr learned my addr 172.21.15.120:0/2665084531 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.613+0000 7f0c7f7fe640 1 -- 172.21.15.120:0/2665084531 >> v1:172.21.15.120:6789/0 conn(0x7f0c8809e710 legacy=0x7f0c88073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.613+0000 7f0c7f7fe640 1 -- 172.21.15.120:0/2665084531 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8809d190 con 0x7f0c88073f60 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.613+0000 7f0c7f7fe640 1 --2- 172.21.15.120:0/2665084531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c8813c360 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b5a246e08b998c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.613+0000 7f0c877fe640 1 -- 172.21.15.120:0/2665084531 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c70009e40 con 0x7f0c88073f60 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.613+0000 7f0c877fe640 1 -- 172.21.15.120:0/2665084531 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0c7000e230 con 0x7f0c88073f60 2024-09-18T13:14:49.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.613+0000 7f0c877fe640 1 -- 172.21.15.120:0/2665084531 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c7000e4d0 con 0x7f0c88073f60 2024-09-18T13:14:49.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 1 -- 172.21.15.120:0/2665084531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 msgr2=0x7f0c8813c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:49.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 1 --2- 172.21.15.120:0/2665084531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c8813c360 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:49.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 1 -- 172.21.15.120:0/2665084531 shutdown_connections 2024-09-18T13:14:49.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 1 --2- 172.21.15.120:0/2665084531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c8813c360 unknown :-1 s=CLOSED pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:49.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 1 -- 172.21.15.120:0/2665084531 >> 172.21.15.120:0/2665084531 conn(0x7f0c880a30a0 msgr2=0x7f0c880a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:49.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 1 -- 172.21.15.120:0/2665084531 shutdown_connections 2024-09-18T13:14:49.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 1 -- 172.21.15.120:0/2665084531 wait complete. 2024-09-18T13:14:49.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.614+0000 7f0c8e263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:49.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.615+0000 7f0c8e263640 1 Processor -- start 2024-09-18T13:14:49.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.615+0000 7f0c8e263640 1 -- start start 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c8e263640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c881c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c8e263640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881aef70 con 0x7f0c88073f60 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c87fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c881c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c87fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c881c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60628/0 (socket says 172.21.15.120:60628) 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c87fff640 1 -- 172.21.15.120:0/407210343 learned_addr learned my addr 172.21.15.120:0/407210343 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c87fff640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c88099620 con 0x7f0c88073f60 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c87fff640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c881c7e20 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c780059a0 con 0x7f0c88073f60 2024-09-18T13:14:49.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0c78005b00 con 0x7f0c88073f60 2024-09-18T13:14:49.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8809b940 con 0x7f0c88073f60 2024-09-18T13:14:49.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c78005da0 con 0x7f0c88073f60 2024-09-18T13:14:49.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.617+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8809af30 con 0x7f0c88073f60 2024-09-18T13:14:49.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.618+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0c780070b0 con 0x7f0c88073f60 2024-09-18T13:14:49.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.619+0000 7f0c857fa640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0c6803e930 0x7f0c68040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:49.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.619+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(707..707 src has 408..707) ==== 3819+0+0 (crc 0 0 0) 0x7f0c7804faa0 con 0x7f0c88073f60 2024-09-18T13:14:49.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.619+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8809e220 con 0x7f0c88073f60 2024-09-18T13:14:49.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.619+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f0c68044bc0 con 0x7f0c88073f60 2024-09-18T13:14:49.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.619+0000 7f0c7f7fe640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0c6803e930 0x7f0c68040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:49.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.620+0000 7f0c7f7fe640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0c6803e930 0x7f0c68040e40 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:49.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.624+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f0c7800f230 con 0x7f0c88073f60 2024-09-18T13:14:49.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:49.798+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"} v 0) -- 0x7f0c8809f670 con 0x7f0c88073f60 2024-09-18T13:14:50.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.470+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v708) ==== 221+0+0 (crc 0 0 0) 0x7f0c7800d660 con 0x7f0c88073f60 2024-09-18T13:14:50.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.471+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(708..708 src has 408..708) ==== 628+0+0 (crc 0 0 0) 0x7f7650035ca0 con 0x1fc6fc0 2024-09-18T13:14:50.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.471+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(708..708 src has 408..708) ==== 628+0+0 (crc 0 0 0) 0x7f0c7800c780 con 0x7f0c88073f60 2024-09-18T13:14:50.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.471+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f0c68045a90 con 0x7f0c88073f60 2024-09-18T13:14:50.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.471+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f764c043d60 con 0x1fc6fc0 2024-09-18T13:14:50.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.471+0000 7f765d7fa640 1 -- 172.21.15.120:0/1877941979 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e708) -- 0x7f764c043fb0 con 0x1fcf130 2024-09-18T13:14:50.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f7665240640 1 -- 172.21.15.120:0/1877941979 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 two [writefull 0~12875] v708'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f765800a430 con 0x1fcf130 2024-09-18T13:14:50.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 >> v2:172.21.15.120:6801/1764758402 conn(0x1fcf130 msgr2=0x20d3770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:50.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 --2- 172.21.15.120:0/1877941979 >> v2:172.21.15.120:6801/1764758402 conn(0x1fcf130 0x20d3770 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:50.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f764c03d170 msgr2=0x7f764c03f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f764c03d170 0x7f764c03f680 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 msgr2=0x20f6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x20f6850 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 shutdown_connections 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 --2- 172.21.15.120:0/1877941979 >> v2:172.21.15.120:6801/1764758402 conn(0x1fcf130 0x20d3770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f764c03d170 0x7f764c03f680 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 --2- 172.21.15.120:0/1877941979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fc6fc0 0x20f6850 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 >> 172.21.15.120:0/1877941979 conn(0x1ef3770 msgr2=0x1fcbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 shutdown_connections 2024-09-18T13:14:50.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.510+0000 7f766c131ec0 1 -- 172.21.15.120:0/1877941979 wait complete. 2024-09-18T13:14:50.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:50.593+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"} v 0) -- 0x7f0c881af3a0 con 0x7f0c88073f60 2024-09-18T13:14:51.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.491+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v709) ==== 221+0+0 (crc 0 0 0) 0x7f0c7800dc20 con 0x7f0c88073f60 2024-09-18T13:14:51.492 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_objects = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:14:51.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.491+0000 7f0c857fa640 1 -- 172.21.15.120:0/407210343 <== mon.0 v2:172.21.15.120:3300/0 10 ==== osd_map(709..709 src has 408..709) ==== 628+0+0 (crc 0 0 0) 0x7f0c780073b0 con 0x7f0c88073f60 2024-09-18T13:14:51.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0c6803e930 msgr2=0x7f0c68040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0c6803e930 0x7f0c68040e40 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 msgr2=0x7f0c881c7e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c881c7e20 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 shutdown_connections 2024-09-18T13:14:51.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f0c6803e930 0x7f0c68040e40 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 --2- 172.21.15.120:0/407210343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c88073f60 0x7f0c881c7e20 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.495+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 >> 172.21.15.120:0/407210343 conn(0x7f0c880a30a0 msgr2=0x7f0c88091330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:51.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.496+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 shutdown_connections 2024-09-18T13:14:51.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.496+0000 7f0c8e263640 1 -- 172.21.15.120:0/407210343 wait complete. 2024-09-18T13:14:51.513 INFO:tasks.workunit.client.0.smithi120.stderr:+ wait 96541 2024-09-18T13:14:51.513 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' 0 -ne 0 ']' 2024-09-18T13:14:51.513 INFO:tasks.workunit.client.0.smithi120.stderr:+ true 2024-09-18T13:14:51.513 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put three /etc/passwd 2024-09-18T13:14:51.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.557+0000 7f1e4c930ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:51.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.562+0000 7f1e4c930ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:51.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.562+0000 7f1e4c930ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:51.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.563+0000 7f1e4c930ec0 1 Processor -- start 2024-09-18T13:14:51.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.563+0000 7f1e4c930ec0 1 -- start start 2024-09-18T13:14:51.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e4c930ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:51.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e4c930ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x12e4520 con 0x1377fc0 2024-09-18T13:14:51.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e44c3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:51.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e44c3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57944/0 (socket says 172.21.15.120:57944) 2024-09-18T13:14:51.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e44c3f640 1 -- 172.21.15.120:0/2992079112 learned_addr learned my addr 172.21.15.120:0/2992079112 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:51.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e44c3f640 1 -- 172.21.15.120:0/2992079112 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1280e10 con 0x1377fc0 2024-09-18T13:14:51.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e44c3f640 1 --2- 172.21.15.120:0/2992079112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149ec60 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882fb43dc707e983 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:51.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e3effd640 1 -- 172.21.15.120:0/2992079112 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e3002dc90 con 0x1377fc0 2024-09-18T13:14:51.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e3effd640 1 -- 172.21.15.120:0/2992079112 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e3002de90 con 0x1377fc0 2024-09-18T13:14:51.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.564+0000 7f1e3effd640 1 -- 172.21.15.120:0/2992079112 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e3000a170 con 0x1377fc0 2024-09-18T13:14:51.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.565+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/2992079112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 msgr2=0x149ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.565+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/2992079112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149ec60 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.565+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/2992079112 shutdown_connections 2024-09-18T13:14:51.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.565+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/2992079112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149ec60 unknown :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.565+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/2992079112 >> 172.21.15.120:0/2992079112 conn(0x12a4770 msgr2=0x137ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:51.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.565+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/2992079112 shutdown_connections 2024-09-18T13:14:51.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.565+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/2992079112 wait complete. 2024-09-18T13:14:51.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.566+0000 7f1e4c930ec0 1 Processor -- start 2024-09-18T13:14:51.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.566+0000 7f1e4c930ec0 1 -- start start 2024-09-18T13:14:51.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.567+0000 7f1e4c930ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:51.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.567+0000 7f1e4c930ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x12e2280 con 0x1377fc0 2024-09-18T13:14:51.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.567+0000 7f1e44c3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:51.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.567+0000 7f1e44c3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57946/0 (socket says 172.21.15.120:57946) 2024-09-18T13:14:51.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.567+0000 7f1e44c3f640 1 -- 172.21.15.120:0/1980317029 learned_addr learned my addr 172.21.15.120:0/1980317029 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:51.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.567+0000 7f1e44c3f640 1 -- 172.21.15.120:0/1980317029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1272920 con 0x1377fc0 2024-09-18T13:14:51.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.568+0000 7f1e44c3f640 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149c200 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:51.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.568+0000 7f1e3dffb640 1 -- 172.21.15.120:0/1980317029 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e3003b040 con 0x1377fc0 2024-09-18T13:14:51.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.568+0000 7f1e3dffb640 1 -- 172.21.15.120:0/1980317029 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e30035630 con 0x1377fc0 2024-09-18T13:14:51.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.568+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1272380 con 0x1377fc0 2024-09-18T13:14:51.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.568+0000 7f1e3dffb640 1 -- 172.21.15.120:0/1980317029 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e300358d0 con 0x1377fc0 2024-09-18T13:14:51.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.568+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1487760 con 0x1377fc0 2024-09-18T13:14:51.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.569+0000 7f1e3dffb640 1 -- 172.21.15.120:0/1980317029 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1e30035a80 con 0x1377fc0 2024-09-18T13:14:51.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.569+0000 7f1e3dffb640 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1e2003d1c0 0x7f1e2003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:51.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.569+0000 7f1e3dffb640 1 -- 172.21.15.120:0/1980317029 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(709..709 src has 408..709) ==== 3819+0+0 (crc 0 0 0) 0x7f1e30032040 con 0x1377fc0 2024-09-18T13:14:51.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.569+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/1980317029 >> v2:172.21.15.120:6801/1764758402 conn(0x1380130 0x1486e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:51.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.569+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e709) -- 0x14895c0 con 0x1380130 2024-09-18T13:14:51.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.569+0000 7f1e37fff640 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1e2003d1c0 0x7f1e2003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.570+0000 7f1e37fff640 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1e2003d1c0 0x7f1e2003f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.570+0000 7f1e45440640 1 --2- 172.21.15.120:0/1980317029 >> v2:172.21.15.120:6801/1764758402 conn(0x1380130 0x1486e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:14:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.573+0000 7f1e45440640 1 --2- 172.21.15.120:0/1980317029 >> v2:172.21.15.120:6801/1764758402 conn(0x1380130 0x1486e50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:51.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e45440640 1 -- 172.21.15.120:0/1980317029 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 three [writefull 0~12875] v709'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1e3800a430 con 0x1380130 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 >> v2:172.21.15.120:6801/1764758402 conn(0x1380130 msgr2=0x1486e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/1980317029 >> v2:172.21.15.120:6801/1764758402 conn(0x1380130 0x1486e50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1e2003d1c0 msgr2=0x7f1e2003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1e2003d1c0 0x7f1e2003f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 msgr2=0x149c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149c200 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 shutdown_connections 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/1980317029 >> v2:172.21.15.120:6801/1764758402 conn(0x1380130 0x1486e50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1e2003d1c0 0x7f1e2003f6d0 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 --2- 172.21.15.120:0/1980317029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1377fc0 0x149c200 unknown :-1 s=CLOSED pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 >> 172.21.15.120:0/1980317029 conn(0x12a4770 msgr2=0x1379700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 shutdown_connections 2024-09-18T13:14:51.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.591+0000 7f1e4c930ec0 1 -- 172.21.15.120:0/1980317029 wait complete. 2024-09-18T13:14:51.596 INFO:tasks.workunit.client.0.smithi120.stderr:++ uuidgen 2024-09-18T13:14:51.597 INFO:tasks.workunit.client.0.smithi120.stderr:+ pp=e3bcff52-a149-48cc-bb99-cc375a6d277f 2024-09-18T13:14:51.597 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool create e3bcff52-a149-48cc-bb99-cc375a6d277f 12 2024-09-18T13:14:51.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.692+0000 7f440d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:51.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.701+0000 7f440d791640 1 Processor -- start 2024-09-18T13:14:51.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.701+0000 7f440d791640 1 -- start start 2024-09-18T13:14:51.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f440d791640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f440806f2f0 0x7f440813b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:51.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f440d791640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440809fa40 con 0x7f440809ecc0 2024-09-18T13:14:51.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f440d791640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f440809fd50 con 0x7f440806f2f0 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f44067fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f440806f2f0 0x7f440813b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f4406ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f440809ecc0 0x7f440806ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34734/0 (socket says 172.21.15.120:34734) 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f4406ffd640 1 -- 172.21.15.120:0/2809471147 learned_addr learned my addr 172.21.15.120:0/2809471147 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f44067fc640 1 -- 172.21.15.120:0/2809471147 >> v1:172.21.15.120:6789/0 conn(0x7f440809ecc0 legacy=0x7f440806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f44067fc640 1 -- 172.21.15.120:0/2809471147 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440809ff70 con 0x7f440806f2f0 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f44067fc640 1 --2- 172.21.15.120:0/2809471147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f440813b2c0 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadb2ce5ab587ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.702+0000 7f4405ffb640 1 -- 172.21.15.120:0/2809471147 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43f0009d90 con 0x7f440806f2f0 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f4405ffb640 1 -- 172.21.15.120:0/2809471147 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43f000e230 con 0x7f440806f2f0 2024-09-18T13:14:51.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f4405ffb640 1 -- 172.21.15.120:0/2809471147 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43f000e4d0 con 0x7f440806f2f0 2024-09-18T13:14:51.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f440d791640 1 -- 172.21.15.120:0/2809471147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 msgr2=0x7f440813b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:51.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f440d791640 1 --2- 172.21.15.120:0/2809471147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f440813b2c0 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f440d791640 1 -- 172.21.15.120:0/2809471147 shutdown_connections 2024-09-18T13:14:51.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f440d791640 1 --2- 172.21.15.120:0/2809471147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f440813b2c0 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:51.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f440d791640 1 -- 172.21.15.120:0/2809471147 >> 172.21.15.120:0/2809471147 conn(0x7f44080a5350 msgr2=0x7f44080a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:51.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f440d791640 1 -- 172.21.15.120:0/2809471147 shutdown_connections 2024-09-18T13:14:51.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.703+0000 7f440d791640 1 -- 172.21.15.120:0/2809471147 wait complete. 2024-09-18T13:14:51.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.704+0000 7f440d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:51.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.705+0000 7f440d791640 1 Processor -- start 2024-09-18T13:14:51.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.705+0000 7f440d791640 1 -- start start 2024-09-18T13:14:51.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.706+0000 7f440d791640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f4408124290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:51.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.706+0000 7f440d791640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4408125be0 con 0x7f440806f2f0 2024-09-18T13:14:51.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.706+0000 7f4406ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f4408124290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:51.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.706+0000 7f4406ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f4408124290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57968/0 (socket says 172.21.15.120:57968) 2024-09-18T13:14:51.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.706+0000 7f4406ffd640 1 -- 172.21.15.120:0/2585920937 learned_addr learned my addr 172.21.15.120:0/2585920937 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:51.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.706+0000 7f4406ffd640 1 -- 172.21.15.120:0/2585920937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4408123ed0 con 0x7f440806f2f0 2024-09-18T13:14:51.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.707+0000 7f4406ffd640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f4408124290 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:51.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.707+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43f80070b0 con 0x7f440806f2f0 2024-09-18T13:14:51.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.707+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43f8007210 con 0x7f440806f2f0 2024-09-18T13:14:51.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.707+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4408125330 con 0x7f440806f2f0 2024-09-18T13:14:51.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.707+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43f80074b0 con 0x7f440806f2f0 2024-09-18T13:14:51.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.707+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4408126c10 con 0x7f440806f2f0 2024-09-18T13:14:51.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.708+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f43f80076a0 con 0x7f440806f2f0 2024-09-18T13:14:51.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.708+0000 7f43ff7fe640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f43e803e960 0x7f43e8040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:51.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.708+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440809e2b0 con 0x7f440806f2f0 2024-09-18T13:14:51.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.708+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(709..709 src has 408..709) ==== 3819+0+0 (crc 0 0 0) 0x7f43f8050480 con 0x7f440806f2f0 2024-09-18T13:14:51.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.708+0000 7f44067fc640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f43e803e960 0x7f43e8040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:51.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.709+0000 7f44067fc640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f43e803e960 0x7f43e8040e70 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:51.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.713+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f43f800fe60 con 0x7f440806f2f0 2024-09-18T13:14:51.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:51.890+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pg_num": 12} v 0) -- 0x7f440806ebe0 con 0x7f440806f2f0 2024-09-18T13:14:52.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.492+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pg_num": 12}]=0 pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' created v710) ==== 176+0+0 (crc 0 0 0) 0x7f43f8009430 con 0x7f440806f2f0 2024-09-18T13:14:52.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.637+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pg_num": 12} v 0) -- 0x7f44080008d0 con 0x7f440806f2f0 2024-09-18T13:14:52.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.638+0000 7f43ff7fe640 1 -- 172.21.15.120:0/2585920937 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pg_num": 12}]=0 pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' already exists v710) ==== 183+0+0 (crc 0 0 0) 0x7f43f8009850 con 0x7f440806f2f0 2024-09-18T13:14:52.639 INFO:tasks.workunit.client.0.smithi120.stderr:pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' already exists 2024-09-18T13:14:52.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f43e803e960 msgr2=0x7f43e8040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f43e803e960 0x7f43e8040e70 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 msgr2=0x7f4408124290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f4408124290 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 shutdown_connections 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f43e803e960 0x7f43e8040e70 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 --2- 172.21.15.120:0/2585920937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440806f2f0 0x7f4408124290 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 >> 172.21.15.120:0/2585920937 conn(0x7f44080a5350 msgr2=0x7f44081bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 shutdown_connections 2024-09-18T13:14:52.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.640+0000 7f440d791640 1 -- 172.21.15.120:0/2585920937 wait complete. 2024-09-18T13:14:52.651 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool application enable e3bcff52-a149-48cc-bb99-cc375a6d277f rados 2024-09-18T13:14:52.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.733+0000 7f323d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:52.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.743+0000 7f323d751640 1 Processor -- start 2024-09-18T13:14:52.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.743+0000 7f323d751640 1 -- start start 2024-09-18T13:14:52.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.744+0000 7f323d751640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3238134150 0x7f3238134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:52.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.744+0000 7f323d751640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323809dda0 con 0x7f3238072cd0 2024-09-18T13:14:52.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.744+0000 7f323d751640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f32380a6280 con 0x7f3238134150 2024-09-18T13:14:52.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.744+0000 7f3236ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3238134150 0x7f3238134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.744+0000 7f3236ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3238134150 0x7f3238134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57972/0 (socket says 172.21.15.120:57972) 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.744+0000 7f32367fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3238072cd0 0x7f32380730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34742/0 (socket says 172.21.15.120:34742) 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.744+0000 7f3236ffd640 1 -- 172.21.15.120:0/2696969316 learned_addr learned my addr 172.21.15.120:0/2696969316 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.745+0000 7f3236ffd640 1 -- 172.21.15.120:0/2696969316 >> v1:172.21.15.120:6789/0 conn(0x7f3238072cd0 legacy=0x7f32380730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.745+0000 7f3236ffd640 1 -- 172.21.15.120:0/2696969316 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323809ef80 con 0x7f3238134150 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.745+0000 7f3235ffb640 1 -- 172.21.15.120:0/2696969316 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13758854 0 0) 0x7f323809dda0 con 0x7f3238072cd0 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.745+0000 7f3236ffd640 1 --2- 172.21.15.120:0/2696969316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238134150 0x7f3238134560 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ae8d4f58c4ecb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.745+0000 7f3235ffb640 1 -- 172.21.15.120:0/2696969316 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3228009e50 con 0x7f3238134150 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.745+0000 7f3235ffb640 1 -- 172.21.15.120:0/2696969316 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f322800e230 con 0x7f3238134150 2024-09-18T13:14:52.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.745+0000 7f3235ffb640 1 -- 172.21.15.120:0/2696969316 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f322800e4d0 con 0x7f3238134150 2024-09-18T13:14:52.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 1 -- 172.21.15.120:0/2696969316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238134150 msgr2=0x7f3238134560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:52.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 1 --2- 172.21.15.120:0/2696969316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238134150 0x7f3238134560 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:52.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 1 -- 172.21.15.120:0/2696969316 shutdown_connections 2024-09-18T13:14:52.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 1 --2- 172.21.15.120:0/2696969316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238134150 0x7f3238134560 unknown :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 1 -- 172.21.15.120:0/2696969316 >> 172.21.15.120:0/2696969316 conn(0x7f32380a43d0 msgr2=0x7f32380a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 1 -- 172.21.15.120:0/2696969316 shutdown_connections 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 1 -- 172.21.15.120:0/2696969316 wait complete. 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.746+0000 7f323d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.747+0000 7f323d751640 1 Processor -- start 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.748+0000 7f323d751640 1 -- start start 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.748+0000 7f323d751640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238072cd0 0x7f3238120f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.748+0000 7f323d751640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3238122460 con 0x7f3238072cd0 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f3236ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238072cd0 0x7f3238120f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:52.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f3236ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238072cd0 0x7f3238120f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57982/0 (socket says 172.21.15.120:57982) 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f3236ffd640 1 -- 172.21.15.120:0/832845425 learned_addr learned my addr 172.21.15.120:0/832845425 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f3236ffd640 1 -- 172.21.15.120:0/832845425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3238124fb0 con 0x7f3238072cd0 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f3236ffd640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238072cd0 0x7f3238120f60 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f322800edc0 con 0x7f3238072cd0 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3228015420 con 0x7f3238072cd0 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32381243a0 con 0x7f3238072cd0 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f32280156c0 con 0x7f3238072cd0 2024-09-18T13:14:52.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.749+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32381229e0 con 0x7f3238072cd0 2024-09-18T13:14:52.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.750+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32380a5f00 con 0x7f3238072cd0 2024-09-18T13:14:52.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.750+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f32280158c0 con 0x7f3238072cd0 2024-09-18T13:14:52.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.751+0000 7f322f7fe640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f321803e8e0 0x7f3218040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:52.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.751+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(710..710 src has 408..710) ==== 4194+0+0 (crc 0 0 0) 0x7f3228051380 con 0x7f3238072cd0 2024-09-18T13:14:52.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.751+0000 7f32367fc640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f321803e8e0 0x7f3218040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:52.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.751+0000 7f32367fc640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f321803e8e0 0x7f3218040df0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:52.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.756+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f322800f2a0 con 0x7f3238072cd0 2024-09-18T13:14:52.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:52.935+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "app": "rados"} v 0) -- 0x7f323809dfb0 con 0x7f3238072cd0 2024-09-18T13:14:53.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:53.500+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "app": "rados"}]=0 enabled application 'rados' on pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' v711) ==== 213+0+0 (crc 0 0 0) 0x7f3228011e00 con 0x7f3238072cd0 2024-09-18T13:14:53.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:53.635+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "app": "rados"} v 0) -- 0x7f32380008d0 con 0x7f3238072cd0 2024-09-18T13:14:54.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.504+0000 7f322f7fe640 1 -- 172.21.15.120:0/832845425 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "app": "rados"}]=0 enabled application 'rados' on pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' v712) ==== 213+0+0 (crc 0 0 0) 0x7f3228010b60 con 0x7f3238072cd0 2024-09-18T13:14:54.505 INFO:tasks.workunit.client.0.smithi120.stderr:enabled application 'rados' on pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.506+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f321803e8e0 msgr2=0x7f3218040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f321803e8e0 0x7f3218040df0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238072cd0 msgr2=0x7f3238120f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238072cd0 0x7f3238120f60 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 shutdown_connections 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f321803e8e0 0x7f3218040df0 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 --2- 172.21.15.120:0/832845425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3238072cd0 0x7f3238120f60 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:54.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 >> 172.21.15.120:0/832845425 conn(0x7f32380a43d0 msgr2=0x7f32381335d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:54.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 shutdown_connections 2024-09-18T13:14:54.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.507+0000 7f323d751640 1 -- 172.21.15.120:0/832845425 wait complete. 2024-09-18T13:14:54.525 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota e3bcff52-a149-48cc-bb99-cc375a6d277f max_objects 10 2024-09-18T13:14:54.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.619+0000 7f1a34911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:54.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.631+0000 7f1a34911640 1 Processor -- start 2024-09-18T13:14:54.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.631+0000 7f1a34911640 1 -- start start 2024-09-18T13:14:54.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a34911640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a3009c830 0x7f1a3009cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a34911640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3006ea50 con 0x7f1a301322c0 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a34911640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3009d6e0 con 0x7f1a3009c830 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a2e59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a3009c830 0x7f1a3009cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a27fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1a301322c0 0x7f1a301326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34752/0 (socket says 172.21.15.120:34752) 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a27fff640 1 -- 172.21.15.120:0/1122465986 learned_addr learned my addr 172.21.15.120:0/1122465986 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a2e59c640 1 -- 172.21.15.120:0/1122465986 >> v1:172.21.15.120:6789/0 conn(0x7f1a301322c0 legacy=0x7f1a301326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a2e59c640 1 -- 172.21.15.120:0/1122465986 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3009c520 con 0x7f1a3009c830 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.632+0000 7f1a2e59c640 1 --2- 172.21.15.120:0/1122465986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a3009cc40 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c2865822fa92c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.633+0000 7f1a2dd9b640 1 -- 172.21.15.120:0/1122465986 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a20009d80 con 0x7f1a3009c830 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.633+0000 7f1a2dd9b640 1 -- 172.21.15.120:0/1122465986 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a2000f340 con 0x7f1a3009c830 2024-09-18T13:14:54.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.633+0000 7f1a2dd9b640 1 -- 172.21.15.120:0/1122465986 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a2000f5e0 con 0x7f1a3009c830 2024-09-18T13:14:54.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.633+0000 7f1a34911640 1 -- 172.21.15.120:0/1122465986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 msgr2=0x7f1a3009cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:54.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.633+0000 7f1a34911640 1 --2- 172.21.15.120:0/1122465986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a3009cc40 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:54.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.634+0000 7f1a34911640 1 -- 172.21.15.120:0/1122465986 shutdown_connections 2024-09-18T13:14:54.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.634+0000 7f1a34911640 1 --2- 172.21.15.120:0/1122465986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a3009cc40 unknown :-1 s=CLOSED pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:54.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.634+0000 7f1a34911640 1 -- 172.21.15.120:0/1122465986 >> 172.21.15.120:0/1122465986 conn(0x7f1a300a2000 msgr2=0x7f1a300a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:54.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.634+0000 7f1a34911640 1 -- 172.21.15.120:0/1122465986 shutdown_connections 2024-09-18T13:14:54.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.634+0000 7f1a34911640 1 -- 172.21.15.120:0/1122465986 wait complete. 2024-09-18T13:14:54.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.634+0000 7f1a34911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:14:54.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.635+0000 7f1a34911640 1 Processor -- start 2024-09-18T13:14:54.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.635+0000 7f1a34911640 1 -- start start 2024-09-18T13:14:54.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.636+0000 7f1a34911640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a30131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:54.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.636+0000 7f1a34911640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3009bf00 con 0x7f1a3009c830 2024-09-18T13:14:54.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.636+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a30131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:54.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.636+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a30131d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58000/0 (socket says 172.21.15.120:58000) 2024-09-18T13:14:54.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.636+0000 7f1a2e59c640 1 -- 172.21.15.120:0/3110506452 learned_addr learned my addr 172.21.15.120:0/3110506452 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:14:54.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.637+0000 7f1a2e59c640 1 -- 172.21.15.120:0/3110506452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3009fc80 con 0x7f1a3009c830 2024-09-18T13:14:54.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.637+0000 7f1a2e59c640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a30131d40 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:54.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.637+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a20012430 con 0x7f1a3009c830 2024-09-18T13:14:54.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.637+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a20012590 con 0x7f1a3009c830 2024-09-18T13:14:54.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.637+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3012f8a0 con 0x7f1a3009c830 2024-09-18T13:14:54.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.637+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a20012830 con 0x7f1a3009c830 2024-09-18T13:14:54.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.637+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301300d0 con 0x7f1a3009c830 2024-09-18T13:14:54.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.638+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3009b600 con 0x7f1a3009c830 2024-09-18T13:14:54.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.638+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1a200129e0 con 0x7f1a3009c830 2024-09-18T13:14:54.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.638+0000 7f1a26ffd640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1a1003e930 0x7f1a10040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:54.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.638+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(712..712 src has 408..712) ==== 4207+0+0 (crc 0 0 0) 0x7f1a20018040 con 0x7f1a3009c830 2024-09-18T13:14:54.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.639+0000 7f1a27fff640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1a1003e930 0x7f1a10040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:54.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.639+0000 7f1a27fff640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1a1003e930 0x7f1a10040e40 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:54.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.644+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f1a2000c150 con 0x7f1a3009c830 2024-09-18T13:14:54.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:54.830+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "field": "max_objects", "val": "10"} v 0) -- 0x7f1a30077c10 con 0x7f1a3009c830 2024-09-18T13:14:55.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:55.471+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e3bcff52-a149-48cc-bb99-cc375a6d277f v713) ==== 223+0+0 (crc 0 0 0) 0x7f1a2000da50 con 0x7f1a3009c830 2024-09-18T13:14:55.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:55.590+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "field": "max_objects", "val": "10"} v 0) -- 0x7f1a3009e220 con 0x7f1a3009c830 2024-09-18T13:14:56.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.511+0000 7f1a26ffd640 1 -- 172.21.15.120:0/3110506452 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e3bcff52-a149-48cc-bb99-cc375a6d277f v714) ==== 223+0+0 (crc 0 0 0) 0x7f1a2000dc30 con 0x7f1a3009c830 2024-09-18T13:14:56.513 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_objects = 10 for pool e3bcff52-a149-48cc-bb99-cc375a6d277f 2024-09-18T13:14:56.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1a1003e930 msgr2=0x7f1a10040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:56.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1a1003e930 0x7f1a10040e40 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:56.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 msgr2=0x7f1a30131d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:56.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a30131d40 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:56.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 shutdown_connections 2024-09-18T13:14:56.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f1a1003e930 0x7f1a10040e40 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:56.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 --2- 172.21.15.120:0/3110506452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a3009c830 0x7f1a30131d40 crc :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:56.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 >> 172.21.15.120:0/3110506452 conn(0x7f1a300a2000 msgr2=0x7f1a300713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:56.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.514+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 shutdown_connections 2024-09-18T13:14:56.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:14:56.515+0000 7f1a34911640 1 -- 172.21.15.120:0/3110506452 wait complete. 2024-09-18T13:14:56.532 INFO:tasks.workunit.client.0.smithi120.stderr:+ sleep 30 2024-09-18T13:15:26.534 INFO:tasks.workunit.client.0.smithi120.stderr:++ seq 1 10 2024-09-18T13:15:26.534 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:26.534 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj1 /etc/passwd 2024-09-18T13:15:26.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.577+0000 7f6c10f32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.582+0000 7f6c10f32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.583+0000 7f6c10f32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.583+0000 7f6c10f32ec0 1 Processor -- start 2024-09-18T13:15:26.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.583+0000 7f6c10f32ec0 1 -- start start 2024-09-18T13:15:26.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.584+0000 7f6c10f32ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a3be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.584+0000 7f6c10f32ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x19a3520 con 0x1a36fc0 2024-09-18T13:15:26.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.584+0000 7f6c0923f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a3be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.584+0000 7f6c0923f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a3be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34706/0 (socket says 172.21.15.120:34706) 2024-09-18T13:15:26.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.584+0000 7f6c0923f640 1 -- 172.21.15.120:0/231574035 learned_addr learned my addr 172.21.15.120:0/231574035 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.585+0000 7f6c0923f640 1 -- 172.21.15.120:0/231574035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x193fe10 con 0x1a36fc0 2024-09-18T13:15:26.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.585+0000 7f6c0923f640 1 --2- 172.21.15.120:0/231574035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a3be70 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f375fbaf3fe95b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.585+0000 7f6c02ffd640 1 -- 172.21.15.120:0/231574035 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bf400b580 con 0x1a36fc0 2024-09-18T13:15:26.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.585+0000 7f6c02ffd640 1 -- 172.21.15.120:0/231574035 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6bf400b6e0 con 0x1a36fc0 2024-09-18T13:15:26.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.585+0000 7f6c02ffd640 1 -- 172.21.15.120:0/231574035 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bf400b980 con 0x1a36fc0 2024-09-18T13:15:26.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/231574035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 msgr2=0x1a3be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/231574035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a3be70 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/231574035 shutdown_connections 2024-09-18T13:15:26.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/231574035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a3be70 unknown :-1 s=CLOSED pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/231574035 >> 172.21.15.120:0/231574035 conn(0x1963770 msgr2=0x1a3ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/231574035 shutdown_connections 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/231574035 wait complete. 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.586+0000 7f6c10f32ec0 1 Processor -- start 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.587+0000 7f6c10f32ec0 1 -- start start 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.587+0000 7f6c10f32ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a24d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.587+0000 7f6c10f32ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x19a1280 con 0x1a36fc0 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c0923f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a24d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c0923f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a24d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34712/0 (socket says 172.21.15.120:34712) 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c0923f640 1 -- 172.21.15.120:0/1085144350 learned_addr learned my addr 172.21.15.120:0/1085144350 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c0923f640 1 -- 172.21.15.120:0/1085144350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1931920 con 0x1a36fc0 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c0923f640 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a24d80 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c01ffb640 1 -- 172.21.15.120:0/1085144350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bf40128e0 con 0x1a36fc0 2024-09-18T13:15:26.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c01ffb640 1 -- 172.21.15.120:0/1085144350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6bf4005040 con 0x1a36fc0 2024-09-18T13:15:26.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1931380 con 0x1a36fc0 2024-09-18T13:15:26.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c01ffb640 1 -- 172.21.15.120:0/1085144350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bf4012b70 con 0x1a36fc0 2024-09-18T13:15:26.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.588+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1b5b710 con 0x1a36fc0 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.589+0000 7f6c01ffb640 1 -- 172.21.15.120:0/1085144350 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6bf400d040 con 0x1a36fc0 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.589+0000 7f6c01ffb640 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6bf003d1c0 0x7f6bf003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.590+0000 7f6c01ffb640 1 -- 172.21.15.120:0/1085144350 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f6bf400a040 con 0x1a36fc0 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.590+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/1085144350 >> v2:172.21.15.120:6803/3478481720 conn(0x1a3f300 0x1b572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.590+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 --> v2:172.21.15.120:6803/3478481720 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x1b42f70 con 0x1a3f300 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.590+0000 7f6c08a3e640 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6bf003d1c0 0x7f6bf003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.590+0000 7f6c08a3e640 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6bf003d1c0 0x7f6bf003f6d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.591+0000 7f6c09a40640 1 --2- 172.21.15.120:0/1085144350 >> v2:172.21.15.120:6803/3478481720 conn(0x1a3f300 0x1b572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:26.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.594+0000 7f6c09a40640 1 --2- 172.21.15.120:0/1085144350 >> v2:172.21.15.120:6803/3478481720 conn(0x1a3f300 0x1b572e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c09a40640 1 -- 172.21.15.120:0/1085144350 <== osd.1 v2:172.21.15.120:6803/3478481720 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6bfc00a430 con 0x1a3f300 2024-09-18T13:15:26.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 >> v2:172.21.15.120:6803/3478481720 conn(0x1a3f300 msgr2=0x1b572e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/1085144350 >> v2:172.21.15.120:6803/3478481720 conn(0x1a3f300 0x1b572e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6bf003d1c0 msgr2=0x7f6bf003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6bf003d1c0 0x7f6bf003f6d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 msgr2=0x1a24d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a24d80 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 shutdown_connections 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/1085144350 >> v2:172.21.15.120:6803/3478481720 conn(0x1a3f300 0x1b572e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f6bf003d1c0 0x7f6bf003f6d0 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 --2- 172.21.15.120:0/1085144350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1a36fc0 0x1a24d80 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 >> 172.21.15.120:0/1085144350 conn(0x1963770 msgr2=0x1a3a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 shutdown_connections 2024-09-18T13:15:26.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.609+0000 7f6c10f32ec0 1 -- 172.21.15.120:0/1085144350 wait complete. 2024-09-18T13:15:26.614 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:26.614 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj2 /etc/passwd 2024-09-18T13:15:26.650 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.648+0000 7f53eccfdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.653+0000 7f53eccfdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.653+0000 7f53eccfdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.654+0000 7f53eccfdec0 1 Processor -- start 2024-09-18T13:15:26.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.654+0000 7f53eccfdec0 1 -- start start 2024-09-18T13:15:26.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.655+0000 7f53eccfdec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x2395c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.655+0000 7f53eccfdec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x21db520 con 0x226efc0 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.655+0000 7f53e503f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x2395c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.655+0000 7f53e503f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x2395c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34734/0 (socket says 172.21.15.120:34734) 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.655+0000 7f53e503f640 1 -- 172.21.15.120:0/3193513765 learned_addr learned my addr 172.21.15.120:0/3193513765 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.655+0000 7f53e503f640 1 -- 172.21.15.120:0/3193513765 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2177e10 con 0x226efc0 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.655+0000 7f53e503f640 1 --2- 172.21.15.120:0/3193513765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x2395c60 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0e369a0e0f628d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53df7fe640 1 -- 172.21.15.120:0/3193513765 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53d002dc90 con 0x226efc0 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53df7fe640 1 -- 172.21.15.120:0/3193513765 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f53d002de90 con 0x226efc0 2024-09-18T13:15:26.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53df7fe640 1 -- 172.21.15.120:0/3193513765 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53d000a170 con 0x226efc0 2024-09-18T13:15:26.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53eccfdec0 1 -- 172.21.15.120:0/3193513765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 msgr2=0x2395c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/3193513765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x2395c60 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53eccfdec0 1 -- 172.21.15.120:0/3193513765 shutdown_connections 2024-09-18T13:15:26.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/3193513765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x2395c60 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53eccfdec0 1 -- 172.21.15.120:0/3193513765 >> 172.21.15.120:0/3193513765 conn(0x219b770 msgr2=0x2273ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53eccfdec0 1 -- 172.21.15.120:0/3193513765 shutdown_connections 2024-09-18T13:15:26.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.656+0000 7f53eccfdec0 1 -- 172.21.15.120:0/3193513765 wait complete. 2024-09-18T13:15:26.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.657+0000 7f53eccfdec0 1 Processor -- start 2024-09-18T13:15:26.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.657+0000 7f53eccfdec0 1 -- start start 2024-09-18T13:15:26.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.658+0000 7f53eccfdec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x237c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.658+0000 7f53eccfdec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x21d9280 con 0x226efc0 2024-09-18T13:15:26.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.658+0000 7f53e503f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x237c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.658+0000 7f53e503f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x237c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34748/0 (socket says 172.21.15.120:34748) 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.658+0000 7f53e503f640 1 -- 172.21.15.120:0/2202115812 learned_addr learned my addr 172.21.15.120:0/2202115812 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.658+0000 7f53e503f640 1 -- 172.21.15.120:0/2202115812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2169920 con 0x226efc0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.659+0000 7f53e503f640 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x237c550 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.659+0000 7f53de7fc640 1 -- 172.21.15.120:0/2202115812 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53d0009620 con 0x226efc0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.659+0000 7f53de7fc640 1 -- 172.21.15.120:0/2202115812 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f53d0009780 con 0x226efc0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.659+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2169380 con 0x226efc0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.659+0000 7f53de7fc640 1 -- 172.21.15.120:0/2202115812 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53d0009a20 con 0x226efc0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.659+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x237c190 con 0x226efc0 2024-09-18T13:15:26.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.660+0000 7f53de7fc640 1 -- 172.21.15.120:0/2202115812 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f53d0009bd0 con 0x226efc0 2024-09-18T13:15:26.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.660+0000 7f53de7fc640 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f53cc03d1c0 0x7f53cc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.660+0000 7f53de7fc640 1 -- 172.21.15.120:0/2202115812 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f53d0032040 con 0x226efc0 2024-09-18T13:15:26.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.660+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/2202115812 >> v2:172.21.15.120:6803/3478481720 conn(0x2277130 0x239e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.660+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 --> v2:172.21.15.120:6803/3478481720 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x237e290 con 0x2277130 2024-09-18T13:15:26.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.660+0000 7f53e483e640 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f53cc03d1c0 0x7f53cc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.661+0000 7f53e483e640 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f53cc03d1c0 0x7f53cc03f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.661+0000 7f53e5840640 1 --2- 172.21.15.120:0/2202115812 >> v2:172.21.15.120:6803/3478481720 conn(0x2277130 0x239e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:26.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.664+0000 7f53e5840640 1 --2- 172.21.15.120:0/2202115812 >> v2:172.21.15.120:6803/3478481720 conn(0x2277130 0x239e940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.679+0000 7f53e5840640 1 -- 172.21.15.120:0/2202115812 <== osd.1 v2:172.21.15.120:6803/3478481720 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f53d800a430 con 0x2277130 2024-09-18T13:15:26.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 >> v2:172.21.15.120:6803/3478481720 conn(0x2277130 msgr2=0x239e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/2202115812 >> v2:172.21.15.120:6803/3478481720 conn(0x2277130 0x239e940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f53cc03d1c0 msgr2=0x7f53cc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f53cc03d1c0 0x7f53cc03f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 msgr2=0x237c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x237c550 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 shutdown_connections 2024-09-18T13:15:26.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/2202115812 >> v2:172.21.15.120:6803/3478481720 conn(0x2277130 0x239e940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f53cc03d1c0 0x7f53cc03f6d0 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 --2- 172.21.15.120:0/2202115812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x226efc0 0x237c550 unknown :-1 s=CLOSED pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 >> 172.21.15.120:0/2202115812 conn(0x219b770 msgr2=0x2270700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 shutdown_connections 2024-09-18T13:15:26.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.680+0000 7f53eccfdec0 1 -- 172.21.15.120:0/2202115812 wait complete. 2024-09-18T13:15:26.684 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:26.685 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj3 /etc/passwd 2024-09-18T13:15:26.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.719+0000 7f8ee5d22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.724+0000 7f8ee5d22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.724+0000 7f8ee5d22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.724+0000 7f8ee5d22ec0 1 Processor -- start 2024-09-18T13:15:26.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.724+0000 7f8ee5d22ec0 1 -- start start 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.725+0000 7f8ee5d22ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xb09590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.725+0000 7f8ee5d22ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x955520 con 0x9f1300 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.725+0000 7f8ede19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xb09590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.725+0000 7f8ede19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xb09590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34770/0 (socket says 172.21.15.120:34770) 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.726+0000 7f8ede19b640 1 -- 172.21.15.120:0/4193124522 learned_addr learned my addr 172.21.15.120:0/4193124522 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.726+0000 7f8ede19b640 1 -- 172.21.15.120:0/4193124522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8f1e10 con 0x9f1300 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.726+0000 7f8ede19b640 1 --2- 172.21.15.120:0/4193124522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xb09590 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e399404d3640b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.726+0000 7f8edc998640 1 -- 172.21.15.120:0/4193124522 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ec802db00 con 0x9f1300 2024-09-18T13:15:26.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.726+0000 7f8edc998640 1 -- 172.21.15.120:0/4193124522 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ec802dc60 con 0x9f1300 2024-09-18T13:15:26.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.726+0000 7f8edc998640 1 -- 172.21.15.120:0/4193124522 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ec802ddd0 con 0x9f1300 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/4193124522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 msgr2=0xb09590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/4193124522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xb09590 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/4193124522 shutdown_connections 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/4193124522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xb09590 unknown :-1 s=CLOSED pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/4193124522 >> 172.21.15.120:0/4193124522 conn(0x915770 msgr2=0x9f36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/4193124522 shutdown_connections 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/4193124522 wait complete. 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.727+0000 7f8ee5d22ec0 1 Processor -- start 2024-09-18T13:15:26.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.728+0000 7f8ee5d22ec0 1 -- start start 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ee5d22ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xa6cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ee5d22ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x953280 con 0x9f1300 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ede19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xa6cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ede19b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xa6cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34780/0 (socket says 172.21.15.120:34780) 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ede19b640 1 -- 172.21.15.120:0/2443935506 learned_addr learned my addr 172.21.15.120:0/2443935506 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ede19b640 1 -- 172.21.15.120:0/2443935506 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8e3920 con 0x9f1300 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ede19b640 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xa6cf90 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ed6ffd640 1 -- 172.21.15.120:0/2443935506 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ec802d7d0 con 0x9f1300 2024-09-18T13:15:26.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ed6ffd640 1 -- 172.21.15.120:0/2443935506 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ec802d930 con 0x9f1300 2024-09-18T13:15:26.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x8e3380 con 0x9f1300 2024-09-18T13:15:26.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ed6ffd640 1 -- 172.21.15.120:0/2443935506 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ec8039bb0 con 0x9f1300 2024-09-18T13:15:26.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.729+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa70780 con 0x9f1300 2024-09-18T13:15:26.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.730+0000 7f8ed6ffd640 1 -- 172.21.15.120:0/2443935506 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8ec8035040 con 0x9f1300 2024-09-18T13:15:26.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.730+0000 7f8ed6ffd640 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ec403d170 0x7f8ec403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.731+0000 7f8ed6ffd640 1 -- 172.21.15.120:0/2443935506 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f8ec803e040 con 0x9f1300 2024-09-18T13:15:26.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.731+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/2443935506 >> v2:172.21.15.176:6802/1480150686 conn(0xa83a60 0xa7fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.731+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 --> v2:172.21.15.176:6802/1480150686 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0xa70210 con 0xa83a60 2024-09-18T13:15:26.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.731+0000 7f8edd99a640 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ec403d170 0x7f8ec403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.731+0000 7f8edd99a640 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ec403d170 0x7f8ec403f680 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.732+0000 7f8ede99c640 1 --2- 172.21.15.120:0/2443935506 >> v2:172.21.15.176:6802/1480150686 conn(0xa83a60 0xa7fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:26.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.736+0000 7f8ede99c640 1 --2- 172.21.15.120:0/2443935506 >> v2:172.21.15.176:6802/1480150686 conn(0xa83a60 0xa7fd30 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ede99c640 1 -- 172.21.15.120:0/2443935506 <== osd.2 v2:172.21.15.176:6802/1480150686 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8ed000c430 con 0xa83a60 2024-09-18T13:15:26.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 >> v2:172.21.15.176:6802/1480150686 conn(0xa83a60 msgr2=0xa7fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/2443935506 >> v2:172.21.15.176:6802/1480150686 conn(0xa83a60 0xa7fd30 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ec403d170 msgr2=0x7f8ec403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ec403d170 0x7f8ec403f680 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 msgr2=0xa6cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xa6cf90 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 shutdown_connections 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/2443935506 >> v2:172.21.15.176:6802/1480150686 conn(0xa83a60 0xa7fd30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f8ec403d170 0x7f8ec403f680 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 --2- 172.21.15.120:0/2443935506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x9f1300 0xa6cf90 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 >> 172.21.15.120:0/2443935506 conn(0x915770 msgr2=0xb09590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 shutdown_connections 2024-09-18T13:15:26.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.754+0000 7f8ee5d22ec0 1 -- 172.21.15.120:0/2443935506 wait complete. 2024-09-18T13:15:26.758 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:26.759 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj4 /etc/passwd 2024-09-18T13:15:26.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.794+0000 7f9881d74ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.799+0000 7f9881d74ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.799+0000 7f9881d74ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.800+0000 7f9881d74ec0 1 Processor -- start 2024-09-18T13:15:26.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.800+0000 7f9881d74ec0 1 -- start start 2024-09-18T13:15:26.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f9881d74ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfc9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f9881d74ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xe99520 con 0xf333d0 2024-09-18T13:15:26.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f987a79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfc9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f987a79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfc9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34804/0 (socket says 172.21.15.120:34804) 2024-09-18T13:15:26.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f987a79b640 1 -- 172.21.15.120:0/504757933 learned_addr learned my addr 172.21.15.120:0/504757933 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f987a79b640 1 -- 172.21.15.120:0/504757933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe35e10 con 0xf333d0 2024-09-18T13:15:26.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f987a79b640 1 --2- 172.21.15.120:0/504757933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfc9de0 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de664b90a246a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f9878f98640 1 -- 172.21.15.120:0/504757933 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f986400c490 con 0xf333d0 2024-09-18T13:15:26.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f9878f98640 1 -- 172.21.15.120:0/504757933 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f986400c5f0 con 0xf333d0 2024-09-18T13:15:26.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.801+0000 7f9878f98640 1 -- 172.21.15.120:0/504757933 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f986400c890 con 0xf333d0 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.802+0000 7f9881d74ec0 1 -- 172.21.15.120:0/504757933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 msgr2=0xfc9de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.802+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/504757933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfc9de0 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.802+0000 7f9881d74ec0 1 -- 172.21.15.120:0/504757933 shutdown_connections 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.802+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/504757933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfc9de0 unknown :-1 s=CLOSED pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.802+0000 7f9881d74ec0 1 -- 172.21.15.120:0/504757933 >> 172.21.15.120:0/504757933 conn(0xe59770 msgr2=0xf2cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.802+0000 7f9881d74ec0 1 -- 172.21.15.120:0/504757933 shutdown_connections 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.802+0000 7f9881d74ec0 1 -- 172.21.15.120:0/504757933 wait complete. 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.803+0000 7f9881d74ec0 1 Processor -- start 2024-09-18T13:15:26.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.803+0000 7f9881d74ec0 1 -- start start 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f9881d74ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfb8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f9881d74ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xe97280 con 0xf333d0 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f987a79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfb8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f987a79b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfb8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34820/0 (socket says 172.21.15.120:34820) 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f987a79b640 1 -- 172.21.15.120:0/2182894554 learned_addr learned my addr 172.21.15.120:0/2182894554 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f987a79b640 1 -- 172.21.15.120:0/2182894554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe27920 con 0xf333d0 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f987a79b640 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfb8310 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f9872ffd640 1 -- 172.21.15.120:0/2182894554 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98640111e0 con 0xf333d0 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f9872ffd640 1 -- 172.21.15.120:0/2182894554 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9864011a30 con 0xf333d0 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xe27380 con 0xf333d0 2024-09-18T13:15:26.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f9872ffd640 1 -- 172.21.15.120:0/2182894554 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9864011ba0 con 0xf333d0 2024-09-18T13:15:26.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.804+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0xfbb630 con 0xf333d0 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.805+0000 7f9872ffd640 1 -- 172.21.15.120:0/2182894554 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9864011d50 con 0xf333d0 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.806+0000 7f9872ffd640 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f986003d1c0 0x7f986003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.806+0000 7f9872ffd640 1 -- 172.21.15.120:0/2182894554 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f98640503a0 con 0xf333d0 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.806+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/2182894554 >> v2:172.21.15.120:6801/1764758402 conn(0xf33ef0 0xfb8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.806+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x1462ca0 con 0xf33ef0 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.806+0000 7f9879f9a640 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f986003d1c0 0x7f986003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.806+0000 7f9879f9a640 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f986003d1c0 0x7f986003f6d0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.807+0000 7f987af9c640 1 --2- 172.21.15.120:0/2182894554 >> v2:172.21.15.120:6801/1764758402 conn(0xf33ef0 0xfb8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:26.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.810+0000 7f987af9c640 1 --2- 172.21.15.120:0/2182894554 >> v2:172.21.15.120:6801/1764758402 conn(0xf33ef0 0xfb8d60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.823+0000 7f987af9c640 1 -- 172.21.15.120:0/2182894554 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f986c00a430 con 0xf33ef0 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.823+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 >> v2:172.21.15.120:6801/1764758402 conn(0xf33ef0 msgr2=0xfb8d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.823+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/2182894554 >> v2:172.21.15.120:6801/1764758402 conn(0xf33ef0 0xfb8d60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f986003d1c0 msgr2=0x7f986003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f986003d1c0 0x7f986003f6d0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 msgr2=0xfb8310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfb8310 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 shutdown_connections 2024-09-18T13:15:26.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/2182894554 >> v2:172.21.15.120:6801/1764758402 conn(0xf33ef0 0xfb8d60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f986003d1c0 0x7f986003f6d0 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 --2- 172.21.15.120:0/2182894554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xf333d0 0xfb8310 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 >> 172.21.15.120:0/2182894554 conn(0xe59770 msgr2=0xf3a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 shutdown_connections 2024-09-18T13:15:26.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.824+0000 7f9881d74ec0 1 -- 172.21.15.120:0/2182894554 wait complete. 2024-09-18T13:15:26.828 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:26.828 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj5 /etc/passwd 2024-09-18T13:15:26.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.862+0000 7f46d4041ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.867+0000 7f46d4041ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.867+0000 7f46d4041ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.868+0000 7f46d4041ec0 1 Processor -- start 2024-09-18T13:15:26.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.868+0000 7f46d4041ec0 1 -- start start 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.869+0000 7f46d4041ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xda17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.869+0000 7f46d4041ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xbea520 con 0xd189b0 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.869+0000 7f46c7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xda17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.869+0000 7f46c7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xda17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34840/0 (socket says 172.21.15.120:34840) 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.869+0000 7f46c7fff640 1 -- 172.21.15.120:0/1716237619 learned_addr learned my addr 172.21.15.120:0/1716237619 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.869+0000 7f46c7fff640 1 -- 172.21.15.120:0/1716237619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb86e10 con 0xd189b0 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46c7fff640 1 --2- 172.21.15.120:0/1716237619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xda17c0 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573cde8cdd7bdbd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46c67fc640 1 -- 172.21.15.120:0/1716237619 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46b802db60 con 0xd189b0 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46c67fc640 1 -- 172.21.15.120:0/1716237619 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46b8037370 con 0xd189b0 2024-09-18T13:15:26.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46c67fc640 1 -- 172.21.15.120:0/1716237619 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46b8037610 con 0xd189b0 2024-09-18T13:15:26.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1716237619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 msgr2=0xda17c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1716237619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xda17c0 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1716237619 shutdown_connections 2024-09-18T13:15:26.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1716237619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xda17c0 unknown :-1 s=CLOSED pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1716237619 >> 172.21.15.120:0/1716237619 conn(0xbaa770 msgr2=0xc821d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1716237619 shutdown_connections 2024-09-18T13:15:26.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.870+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1716237619 wait complete. 2024-09-18T13:15:26.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.871+0000 7f46d4041ec0 1 Processor -- start 2024-09-18T13:15:26.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.871+0000 7f46d4041ec0 1 -- start start 2024-09-18T13:15:26.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.872+0000 7f46d4041ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xd05c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.872+0000 7f46d4041ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0xbe8280 con 0xd189b0 2024-09-18T13:15:26.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.872+0000 7f46c7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xd05c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.872+0000 7f46c7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xd05c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34842/0 (socket says 172.21.15.120:34842) 2024-09-18T13:15:26.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.872+0000 7f46c7fff640 1 -- 172.21.15.120:0/1671804055 learned_addr learned my addr 172.21.15.120:0/1671804055 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.873+0000 7f46c7fff640 1 -- 172.21.15.120:0/1671804055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb78920 con 0xd189b0 2024-09-18T13:15:26.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.873+0000 7f46c7fff640 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xd05c50 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.873+0000 7f46c57fa640 1 -- 172.21.15.120:0/1671804055 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46b803e040 con 0xd189b0 2024-09-18T13:15:26.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.873+0000 7f46c57fa640 1 -- 172.21.15.120:0/1671804055 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46b802da30 con 0xd189b0 2024-09-18T13:15:26.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.873+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb78380 con 0xd189b0 2024-09-18T13:15:26.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.873+0000 7f46c57fa640 1 -- 172.21.15.120:0/1671804055 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46b8037610 con 0xd189b0 2024-09-18T13:15:26.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.873+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc7f8e0 con 0xd189b0 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.874+0000 7f46c57fa640 1 -- 172.21.15.120:0/1671804055 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f46b8039450 con 0xd189b0 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.874+0000 7f46c57fa640 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46b403d1c0 0x7f46b403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.874+0000 7f46c57fa640 1 -- 172.21.15.120:0/1671804055 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f46b8032040 con 0xd189b0 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.875+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1671804055 >> v2:172.21.15.120:6801/1764758402 conn(0xd19300 0xd066a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.875+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 --> v2:172.21.15.120:6801/1764758402 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0xd08c90 con 0xd19300 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.875+0000 7f46c77fe640 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46b403d1c0 0x7f46b403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.875+0000 7f46c77fe640 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46b403d1c0 0x7f46b403f6d0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.875+0000 7f46cc99c640 1 --2- 172.21.15.120:0/1671804055 >> v2:172.21.15.120:6801/1764758402 conn(0xd19300 0xd066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:26.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.879+0000 7f46cc99c640 1 --2- 172.21.15.120:0/1671804055 >> v2:172.21.15.120:6801/1764758402 conn(0xd19300 0xd066a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.892+0000 7f46cc99c640 1 -- 172.21.15.120:0/1671804055 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f46c000a430 con 0xd19300 2024-09-18T13:15:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.892+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 >> v2:172.21.15.120:6801/1764758402 conn(0xd19300 msgr2=0xd066a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.892+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1671804055 >> v2:172.21.15.120:6801/1764758402 conn(0xd19300 0xd066a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46b403d1c0 msgr2=0x7f46b403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46b403d1c0 0x7f46b403f6d0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 msgr2=0xd05c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xd05c50 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 shutdown_connections 2024-09-18T13:15:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1671804055 >> v2:172.21.15.120:6801/1764758402 conn(0xd19300 0xd066a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f46b403d1c0 0x7f46b403f6d0 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 --2- 172.21.15.120:0/1671804055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0xd189b0 0xd05c50 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 >> 172.21.15.120:0/1671804055 conn(0xbaa770 msgr2=0xda17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 shutdown_connections 2024-09-18T13:15:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.893+0000 7f46d4041ec0 1 -- 172.21.15.120:0/1671804055 wait complete. 2024-09-18T13:15:26.897 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:26.897 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj6 /etc/passwd 2024-09-18T13:15:26.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.932+0000 7fd45d531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.938+0000 7fd45d531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.938+0000 7fd45d531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:26.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.938+0000 7fd45d531ec0 1 Processor -- start 2024-09-18T13:15:26.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.938+0000 7fd45d531ec0 1 -- start start 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.939+0000 7fd45d531ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x87a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.939+0000 7fd45d531ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x6c4520 con 0x7f29b0 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.939+0000 7fd455e3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x87a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.939+0000 7fd455e3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x87a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34854/0 (socket says 172.21.15.120:34854) 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.939+0000 7fd455e3f640 1 -- 172.21.15.120:0/1378218726 learned_addr learned my addr 172.21.15.120:0/1378218726 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd455e3f640 1 -- 172.21.15.120:0/1378218726 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x660e10 con 0x7f29b0 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd455e3f640 1 --2- 172.21.15.120:0/1378218726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x87a8f0 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23f2d5d9a7d5dad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd44f7fe640 1 -- 172.21.15.120:0/1378218726 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd44000b500 con 0x7f29b0 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd44f7fe640 1 -- 172.21.15.120:0/1378218726 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd44000b660 con 0x7f29b0 2024-09-18T13:15:26.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd44f7fe640 1 -- 172.21.15.120:0/1378218726 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd44000b900 con 0x7f29b0 2024-09-18T13:15:26.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd45d531ec0 1 -- 172.21.15.120:0/1378218726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 msgr2=0x87a8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/1378218726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x87a8f0 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd45d531ec0 1 -- 172.21.15.120:0/1378218726 shutdown_connections 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/1378218726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x87a8f0 unknown :-1 s=CLOSED pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.940+0000 7fd45d531ec0 1 -- 172.21.15.120:0/1378218726 >> 172.21.15.120:0/1378218726 conn(0x684770 msgr2=0x75d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.941+0000 7fd45d531ec0 1 -- 172.21.15.120:0/1378218726 shutdown_connections 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.941+0000 7fd45d531ec0 1 -- 172.21.15.120:0/1378218726 wait complete. 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.941+0000 7fd45d531ec0 1 Processor -- start 2024-09-18T13:15:26.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.941+0000 7fd45d531ec0 1 -- start start 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.942+0000 7fd45d531ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x7de220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.942+0000 7fd45d531ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x6c2280 con 0x7f29b0 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.942+0000 7fd455e3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x7de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.942+0000 7fd455e3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x7de220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34864/0 (socket says 172.21.15.120:34864) 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.942+0000 7fd455e3f640 1 -- 172.21.15.120:0/6974116 learned_addr learned my addr 172.21.15.120:0/6974116 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.943+0000 7fd455e3f640 1 -- 172.21.15.120:0/6974116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x652920 con 0x7f29b0 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.943+0000 7fd455e3f640 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x7de220 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.943+0000 7fd44e7fc640 1 -- 172.21.15.120:0/6974116 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4400110b0 con 0x7f29b0 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.943+0000 7fd44e7fc640 1 -- 172.21.15.120:0/6974116 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd440011210 con 0x7f29b0 2024-09-18T13:15:26.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.943+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x652380 con 0x7f29b0 2024-09-18T13:15:26.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.943+0000 7fd44e7fc640 1 -- 172.21.15.120:0/6974116 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd440011b30 con 0x7f29b0 2024-09-18T13:15:26.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.943+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7e0410 con 0x7f29b0 2024-09-18T13:15:26.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.944+0000 7fd44e7fc640 1 -- 172.21.15.120:0/6974116 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd440011ce0 con 0x7f29b0 2024-09-18T13:15:26.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.944+0000 7fd44e7fc640 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fd43c03d1c0 0x7fd43c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.944+0000 7fd44e7fc640 1 -- 172.21.15.120:0/6974116 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7fd4400503a0 con 0x7f29b0 2024-09-18T13:15:26.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.944+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/6974116 >> v2:172.21.15.176:6806/2606993558 conn(0x7f13f0 0x7f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.944+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x7e1a60 con 0x7f13f0 2024-09-18T13:15:26.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.945+0000 7fd45563e640 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fd43c03d1c0 0x7fd43c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.945+0000 7fd45563e640 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fd43c03d1c0 0x7fd43c03f6d0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.946+0000 7fd456640640 1 --2- 172.21.15.120:0/6974116 >> v2:172.21.15.176:6806/2606993558 conn(0x7f13f0 0x7f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:26.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.950+0000 7fd456640640 1 --2- 172.21.15.120:0/6974116 >> v2:172.21.15.176:6806/2606993558 conn(0x7f13f0 0x7f1800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd456640640 1 -- 172.21.15.120:0/6974116 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd44800a430 con 0x7f13f0 2024-09-18T13:15:26.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 >> v2:172.21.15.176:6806/2606993558 conn(0x7f13f0 msgr2=0x7f1800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/6974116 >> v2:172.21.15.176:6806/2606993558 conn(0x7f13f0 0x7f1800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fd43c03d1c0 msgr2=0x7fd43c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fd43c03d1c0 0x7fd43c03f6d0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 msgr2=0x7de220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x7de220 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 shutdown_connections 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/6974116 >> v2:172.21.15.176:6806/2606993558 conn(0x7f13f0 0x7f1800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fd43c03d1c0 0x7fd43c03f6d0 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 --2- 172.21.15.120:0/6974116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b0 0x7de220 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 >> 172.21.15.120:0/6974116 conn(0x684770 msgr2=0x75baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 shutdown_connections 2024-09-18T13:15:26.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:26.966+0000 7fd45d531ec0 1 -- 172.21.15.120:0/6974116 wait complete. 2024-09-18T13:15:26.971 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:26.971 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj7 /etc/passwd 2024-09-18T13:15:27.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.004+0000 7f97a2839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.009+0000 7f97a2839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.009+0000 7f97a2839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.010+0000 7f97a2839ec0 1 Processor -- start 2024-09-18T13:15:27.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.010+0000 7f97a2839ec0 1 -- start start 2024-09-18T13:15:27.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.011+0000 7f97a2839ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1ef8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.011+0000 7f97a2839ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1ddf520 con 0x1f0d9b0 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.011+0000 7f979a99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1ef8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.011+0000 7f979a99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1ef8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34884/0 (socket says 172.21.15.120:34884) 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.011+0000 7f979a99b640 1 -- 172.21.15.120:0/1319751306 learned_addr learned my addr 172.21.15.120:0/1319751306 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.011+0000 7f979a99b640 1 -- 172.21.15.120:0/1319751306 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d7be10 con 0x1f0d9b0 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.011+0000 7f979a99b640 1 --2- 172.21.15.120:0/1319751306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1ef8850 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8046067a69909c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f9799198640 1 -- 172.21.15.120:0/1319751306 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f978402db60 con 0x1f0d9b0 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f9799198640 1 -- 172.21.15.120:0/1319751306 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9784037370 con 0x1f0d9b0 2024-09-18T13:15:27.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f9799198640 1 -- 172.21.15.120:0/1319751306 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9784037610 con 0x1f0d9b0 2024-09-18T13:15:27.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1319751306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 msgr2=0x1ef8850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1319751306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1ef8850 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1319751306 shutdown_connections 2024-09-18T13:15:27.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1319751306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1ef8850 unknown :-1 s=CLOSED pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1319751306 >> 172.21.15.120:0/1319751306 conn(0x1d9f770 msgr2=0x1e78230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1319751306 shutdown_connections 2024-09-18T13:15:27.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.012+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1319751306 wait complete. 2024-09-18T13:15:27.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.013+0000 7f97a2839ec0 1 Processor -- start 2024-09-18T13:15:27.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.013+0000 7f97a2839ec0 1 -- start start 2024-09-18T13:15:27.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.014+0000 7f97a2839ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1e72e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.014+0000 7f97a2839ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1ddd280 con 0x1f0d9b0 2024-09-18T13:15:27.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.014+0000 7f979a99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1e72e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.014+0000 7f979a99b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1e72e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34886/0 (socket says 172.21.15.120:34886) 2024-09-18T13:15:27.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.014+0000 7f979a99b640 1 -- 172.21.15.120:0/1021745555 learned_addr learned my addr 172.21.15.120:0/1021745555 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.015+0000 7f979a99b640 1 -- 172.21.15.120:0/1021745555 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d6d920 con 0x1f0d9b0 2024-09-18T13:15:27.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.015+0000 7f979a99b640 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1e72e00 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.015+0000 7f97937fe640 1 -- 172.21.15.120:0/1021745555 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97840377c0 con 0x1f0d9b0 2024-09-18T13:15:27.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.015+0000 7f97937fe640 1 -- 172.21.15.120:0/1021745555 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9784037920 con 0x1f0d9b0 2024-09-18T13:15:27.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.015+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1d6d380 con 0x1f0d9b0 2024-09-18T13:15:27.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.015+0000 7f97937fe640 1 -- 172.21.15.120:0/1021745555 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9784037bc0 con 0x1f0d9b0 2024-09-18T13:15:27.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.015+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1f01150 con 0x1f0d9b0 2024-09-18T13:15:27.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.016+0000 7f97937fe640 1 -- 172.21.15.120:0/1021745555 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9784037d70 con 0x1f0d9b0 2024-09-18T13:15:27.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.016+0000 7f97937fe640 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f978003d1c0 0x7f978003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.016+0000 7f97937fe640 1 -- 172.21.15.120:0/1021745555 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f9784032040 con 0x1f0d9b0 2024-09-18T13:15:27.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.016+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1021745555 >> v2:172.21.15.176:6806/2606993558 conn(0x1f0e300 0x1fa49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.016+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x1f017c0 con 0x1f0e300 2024-09-18T13:15:27.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.016+0000 7f979a19a640 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f978003d1c0 0x7f978003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.017+0000 7f979a19a640 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f978003d1c0 0x7f978003f6d0 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.017+0000 7f979b19c640 1 --2- 172.21.15.120:0/1021745555 >> v2:172.21.15.176:6806/2606993558 conn(0x1f0e300 0x1fa49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:27.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.020+0000 7f979b19c640 1 --2- 172.21.15.120:0/1021745555 >> v2:172.21.15.176:6806/2606993558 conn(0x1f0e300 0x1fa49f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.035+0000 7f979b19c640 1 -- 172.21.15.120:0/1021745555 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f978c00a430 con 0x1f0e300 2024-09-18T13:15:27.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 >> v2:172.21.15.176:6806/2606993558 conn(0x1f0e300 msgr2=0x1fa49f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1021745555 >> v2:172.21.15.176:6806/2606993558 conn(0x1f0e300 0x1fa49f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f978003d1c0 msgr2=0x7f978003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f978003d1c0 0x7f978003f6d0 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 msgr2=0x1e72e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1e72e00 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 shutdown_connections 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1021745555 >> v2:172.21.15.176:6806/2606993558 conn(0x1f0e300 0x1fa49f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f978003d1c0 0x7f978003f6d0 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 --2- 172.21.15.120:0/1021745555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1f0d9b0 0x1e72e00 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 >> 172.21.15.120:0/1021745555 conn(0x1d9f770 msgr2=0x1e78230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 shutdown_connections 2024-09-18T13:15:27.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.036+0000 7f97a2839ec0 1 -- 172.21.15.120:0/1021745555 wait complete. 2024-09-18T13:15:27.040 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:27.040 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj8 /etc/passwd 2024-09-18T13:15:27.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.075+0000 7f5d68031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.080+0000 7f5d68031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.080+0000 7f5d68031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.081+0000 7f5d68031ec0 1 Processor -- start 2024-09-18T13:15:27.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.081+0000 7f5d68031ec0 1 -- start start 2024-09-18T13:15:27.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d68031ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x25189b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d68031ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x2479520 con 0x25a79b0 2024-09-18T13:15:27.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x25189b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x25189b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34900/0 (socket says 172.21.15.120:34900) 2024-09-18T13:15:27.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5b7fe640 1 -- 172.21.15.120:0/310680131 learned_addr learned my addr 172.21.15.120:0/310680131 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5b7fe640 1 -- 172.21.15.120:0/310680131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2415e10 con 0x25a79b0 2024-09-18T13:15:27.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5b7fe640 1 --2- 172.21.15.120:0/310680131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x25189b0 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875f81aa80f81130 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5a7fc640 1 -- 172.21.15.120:0/310680131 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d4c00b580 con 0x25a79b0 2024-09-18T13:15:27.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5a7fc640 1 -- 172.21.15.120:0/310680131 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d4c00b6e0 con 0x25a79b0 2024-09-18T13:15:27.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.082+0000 7f5d5a7fc640 1 -- 172.21.15.120:0/310680131 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d4c00b980 con 0x25a79b0 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.083+0000 7f5d68031ec0 1 -- 172.21.15.120:0/310680131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 msgr2=0x25189b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.083+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/310680131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x25189b0 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.083+0000 7f5d68031ec0 1 -- 172.21.15.120:0/310680131 shutdown_connections 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.083+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/310680131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x25189b0 unknown :-1 s=CLOSED pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.083+0000 7f5d68031ec0 1 -- 172.21.15.120:0/310680131 >> 172.21.15.120:0/310680131 conn(0x2439770 msgr2=0x2510e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.083+0000 7f5d68031ec0 1 -- 172.21.15.120:0/310680131 shutdown_connections 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.083+0000 7f5d68031ec0 1 -- 172.21.15.120:0/310680131 wait complete. 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.084+0000 7f5d68031ec0 1 Processor -- start 2024-09-18T13:15:27.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.084+0000 7f5d68031ec0 1 -- start start 2024-09-18T13:15:27.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d68031ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x263c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d68031ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x2477280 con 0x25a79b0 2024-09-18T13:15:27.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d5b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x263c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d5b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x263c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34912/0 (socket says 172.21.15.120:34912) 2024-09-18T13:15:27.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d5b7fe640 1 -- 172.21.15.120:0/3549746479 learned_addr learned my addr 172.21.15.120:0/3549746479 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d5b7fe640 1 -- 172.21.15.120:0/3549746479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2407920 con 0x25a79b0 2024-09-18T13:15:27.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d5b7fe640 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x263c500 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d597fa640 1 -- 172.21.15.120:0/3549746479 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d4c012960 con 0x25a79b0 2024-09-18T13:15:27.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d597fa640 1 -- 172.21.15.120:0/3549746479 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d4c005040 con 0x25a79b0 2024-09-18T13:15:27.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2407380 con 0x25a79b0 2024-09-18T13:15:27.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d597fa640 1 -- 172.21.15.120:0/3549746479 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d4c012bf0 con 0x25a79b0 2024-09-18T13:15:27.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.085+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2593640 con 0x25a79b0 2024-09-18T13:15:27.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.086+0000 7f5d597fa640 1 -- 172.21.15.120:0/3549746479 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5d4c00d040 con 0x25a79b0 2024-09-18T13:15:27.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.086+0000 7f5d597fa640 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5d3c03d1c0 0x7f5d3c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.087+0000 7f5d597fa640 1 -- 172.21.15.120:0/3549746479 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f5d4c00a040 con 0x25a79b0 2024-09-18T13:15:27.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.087+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/3549746479 >> v2:172.21.15.176:6806/2606993558 conn(0x25a84d0 0x25a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.087+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 --> v2:172.21.15.176:6806/2606993558 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x2596ae0 con 0x25a84d0 2024-09-18T13:15:27.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.087+0000 7f5d52ffd640 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5d3c03d1c0 0x7f5d3c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.087+0000 7f5d52ffd640 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5d3c03d1c0 0x7f5d3c03f6d0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.088+0000 7f5d60840640 1 --2- 172.21.15.120:0/3549746479 >> v2:172.21.15.176:6806/2606993558 conn(0x25a84d0 0x25a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:27.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.092+0000 7f5d60840640 1 --2- 172.21.15.120:0/3549746479 >> v2:172.21.15.176:6806/2606993558 conn(0x25a84d0 0x25a6600 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d60840640 1 -- 172.21.15.120:0/3549746479 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d5400a430 con 0x25a84d0 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 >> v2:172.21.15.176:6806/2606993558 conn(0x25a84d0 msgr2=0x25a6600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/3549746479 >> v2:172.21.15.176:6806/2606993558 conn(0x25a84d0 0x25a6600 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5d3c03d1c0 msgr2=0x7f5d3c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5d3c03d1c0 0x7f5d3c03f6d0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 msgr2=0x263c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x263c500 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 shutdown_connections 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/3549746479 >> v2:172.21.15.176:6806/2606993558 conn(0x25a84d0 0x25a6600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5d3c03d1c0 0x7f5d3c03f6d0 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 --2- 172.21.15.120:0/3549746479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x25a79b0 0x263c500 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 >> 172.21.15.120:0/3549746479 conn(0x2439770 msgr2=0x2510930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 shutdown_connections 2024-09-18T13:15:27.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.127+0000 7f5d68031ec0 1 -- 172.21.15.120:0/3549746479 wait complete. 2024-09-18T13:15:27.131 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:27.131 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj9 /etc/passwd 2024-09-18T13:15:27.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.166+0000 7fa2b5126ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.171+0000 7fa2b5126ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.171+0000 7fa2b5126ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.172+0000 7fa2b5126ec0 1 Processor -- start 2024-09-18T13:15:27.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.172+0000 7fa2b5126ec0 1 -- start start 2024-09-18T13:15:27.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2b5126ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x1fa9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2b5126ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1f27520 con 0x1fbafc0 2024-09-18T13:15:27.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2ad59b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x1fa9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2ad59b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x1fa9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34924/0 (socket says 172.21.15.120:34924) 2024-09-18T13:15:27.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2ad59b640 1 -- 172.21.15.120:0/2908887325 learned_addr learned my addr 172.21.15.120:0/2908887325 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2ad59b640 1 -- 172.21.15.120:0/2908887325 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1ec3e10 con 0x1fbafc0 2024-09-18T13:15:27.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2ad59b640 1 --2- 172.21.15.120:0/2908887325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x1fa9090 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9a317737e2e065 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2a6ffd640 1 -- 172.21.15.120:0/2908887325 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa29802dc90 con 0x1fbafc0 2024-09-18T13:15:27.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.173+0000 7fa2a6ffd640 1 -- 172.21.15.120:0/2908887325 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa29802de90 con 0x1fbafc0 2024-09-18T13:15:27.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2a6ffd640 1 -- 172.21.15.120:0/2908887325 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa29800a170 con 0x1fbafc0 2024-09-18T13:15:27.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/2908887325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 msgr2=0x1fa9090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/2908887325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x1fa9090 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/2908887325 shutdown_connections 2024-09-18T13:15:27.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/2908887325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x1fa9090 unknown :-1 s=CLOSED pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/2908887325 >> 172.21.15.120:0/2908887325 conn(0x1ee7770 msgr2=0x1fbfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/2908887325 shutdown_connections 2024-09-18T13:15:27.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.174+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/2908887325 wait complete. 2024-09-18T13:15:27.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.175+0000 7fa2b5126ec0 1 Processor -- start 2024-09-18T13:15:27.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.175+0000 7fa2b5126ec0 1 -- start start 2024-09-18T13:15:27.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.176+0000 7fa2b5126ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x20ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.176+0000 7fa2b5126ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1f25280 con 0x1fbafc0 2024-09-18T13:15:27.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.176+0000 7fa2ad59b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x20ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.176+0000 7fa2ad59b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x20ea3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34926/0 (socket says 172.21.15.120:34926) 2024-09-18T13:15:27.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.176+0000 7fa2ad59b640 1 -- 172.21.15.120:0/3489196055 learned_addr learned my addr 172.21.15.120:0/3489196055 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.176+0000 7fa2ad59b640 1 -- 172.21.15.120:0/3489196055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1eb5920 con 0x1fbafc0 2024-09-18T13:15:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.177+0000 7fa2ad59b640 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x20ea3a0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.177+0000 7fa2a5ffb640 1 -- 172.21.15.120:0/3489196055 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa298009620 con 0x1fbafc0 2024-09-18T13:15:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.177+0000 7fa2a5ffb640 1 -- 172.21.15.120:0/3489196055 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa298009780 con 0x1fbafc0 2024-09-18T13:15:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.177+0000 7fa2a5ffb640 1 -- 172.21.15.120:0/3489196055 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa298009a20 con 0x1fbafc0 2024-09-18T13:15:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.177+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1eb5380 con 0x1fbafc0 2024-09-18T13:15:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.177+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20e0ac0 con 0x1fbafc0 2024-09-18T13:15:27.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.178+0000 7fa2a5ffb640 1 -- 172.21.15.120:0/3489196055 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa298009c20 con 0x1fbafc0 2024-09-18T13:15:27.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.178+0000 7fa2a5ffb640 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa29403d170 0x7fa29403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.178+0000 7fa2a5ffb640 1 -- 172.21.15.120:0/3489196055 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7fa298032040 con 0x1fbafc0 2024-09-18T13:15:27.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.178+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/3489196055 >> v2:172.21.15.120:6803/3478481720 conn(0x1fc3130 0x20df810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.178+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 --> v2:172.21.15.120:6803/3478481720 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x20ca530 con 0x1fc3130 2024-09-18T13:15:27.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.178+0000 7fa2acd9a640 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa29403d170 0x7fa29403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.179+0000 7fa2acd9a640 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa29403d170 0x7fa29403f680 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.179+0000 7fa2add9c640 1 --2- 172.21.15.120:0/3489196055 >> v2:172.21.15.120:6803/3478481720 conn(0x1fc3130 0x20df810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:27.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.182+0000 7fa2add9c640 1 --2- 172.21.15.120:0/3489196055 >> v2:172.21.15.120:6803/3478481720 conn(0x1fc3130 0x20df810 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2add9c640 1 -- 172.21.15.120:0/3489196055 <== osd.1 v2:172.21.15.120:6803/3478481720 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v715'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa2a000a430 con 0x1fc3130 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 >> v2:172.21.15.120:6803/3478481720 conn(0x1fc3130 msgr2=0x20df810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/3489196055 >> v2:172.21.15.120:6803/3478481720 conn(0x1fc3130 0x20df810 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa29403d170 msgr2=0x7fa29403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa29403d170 0x7fa29403f680 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 msgr2=0x20ea3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x20ea3a0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 shutdown_connections 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/3489196055 >> v2:172.21.15.120:6803/3478481720 conn(0x1fc3130 0x20df810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa29403d170 0x7fa29403f680 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 --2- 172.21.15.120:0/3489196055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1fbafc0 0x20ea3a0 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.196+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 >> 172.21.15.120:0/3489196055 conn(0x1ee7770 msgr2=0x1fa9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.197+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 shutdown_connections 2024-09-18T13:15:27.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.197+0000 7fa2b5126ec0 1 -- 172.21.15.120:0/3489196055 wait complete. 2024-09-18T13:15:27.201 INFO:tasks.workunit.client.0.smithi120.stderr:+ for f in `seq 1 10` 2024-09-18T13:15:27.201 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p e3bcff52-a149-48cc-bb99-cc375a6d277f put obj10 /etc/passwd 2024-09-18T13:15:27.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.235+0000 7f6841b22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.240+0000 7f6841b22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.240+0000 7f6841b22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:27.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.241+0000 7f6841b22ec0 1 Processor -- start 2024-09-18T13:15:27.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.241+0000 7f6841b22ec0 1 -- start start 2024-09-18T13:15:27.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.242+0000 7f6841b22ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x159a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.242+0000 7f6841b22ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x146e520 con 0x15983c0 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.242+0000 7f6839f9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x159a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.242+0000 7f6839f9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x159a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34950/0 (socket says 172.21.15.120:34950) 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.242+0000 7f6839f9b640 1 -- 172.21.15.120:0/4238115103 learned_addr learned my addr 172.21.15.120:0/4238115103 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.242+0000 7f6839f9b640 1 -- 172.21.15.120:0/4238115103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x140ae10 con 0x15983c0 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.242+0000 7f6839f9b640 1 --2- 172.21.15.120:0/4238115103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x159a090 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25814970001ec5d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f68337fe640 1 -- 172.21.15.120:0/4238115103 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f682c02db00 con 0x15983c0 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f68337fe640 1 -- 172.21.15.120:0/4238115103 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f682c02dc60 con 0x15983c0 2024-09-18T13:15:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f68337fe640 1 -- 172.21.15.120:0/4238115103 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f682c02ddd0 con 0x15983c0 2024-09-18T13:15:27.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f6841b22ec0 1 -- 172.21.15.120:0/4238115103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 msgr2=0x159a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/4238115103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x159a090 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f6841b22ec0 1 -- 172.21.15.120:0/4238115103 shutdown_connections 2024-09-18T13:15:27.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/4238115103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x159a090 unknown :-1 s=CLOSED pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f6841b22ec0 1 -- 172.21.15.120:0/4238115103 >> 172.21.15.120:0/4238115103 conn(0x142e770 msgr2=0x159c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f6841b22ec0 1 -- 172.21.15.120:0/4238115103 shutdown_connections 2024-09-18T13:15:27.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.243+0000 7f6841b22ec0 1 -- 172.21.15.120:0/4238115103 wait complete. 2024-09-18T13:15:27.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.244+0000 7f6841b22ec0 1 Processor -- start 2024-09-18T13:15:27.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.244+0000 7f6841b22ec0 1 -- start start 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.245+0000 7f6841b22ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x16338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.245+0000 7f6841b22ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x146c280 con 0x15983c0 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.245+0000 7f6839f9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x16338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.245+0000 7f6839f9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x16338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34956/0 (socket says 172.21.15.120:34956) 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.245+0000 7f6839f9b640 1 -- 172.21.15.120:0/3939961556 learned_addr learned my addr 172.21.15.120:0/3939961556 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.246+0000 7f6839f9b640 1 -- 172.21.15.120:0/3939961556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13fc920 con 0x15983c0 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.246+0000 7f6839f9b640 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x16338c0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.246+0000 7f68327fc640 1 -- 172.21.15.120:0/3939961556 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f682c02db00 con 0x15983c0 2024-09-18T13:15:27.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.246+0000 7f68327fc640 1 -- 172.21.15.120:0/3939961556 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f682c02d7d0 con 0x15983c0 2024-09-18T13:15:27.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.246+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13fc380 con 0x15983c0 2024-09-18T13:15:27.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.246+0000 7f68327fc640 1 -- 172.21.15.120:0/3939961556 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f682c037a60 con 0x15983c0 2024-09-18T13:15:27.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.246+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1587f60 con 0x15983c0 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.247+0000 7f68327fc640 1 -- 172.21.15.120:0/3939961556 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f682c003040 con 0x15983c0 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.247+0000 7f68327fc640 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681403d1c0 0x7f681403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.247+0000 7f68327fc640 1 -- 172.21.15.120:0/3939961556 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(715..715 src has 408..715) ==== 4207+0+0 (crc 0 0 0) 0x7f682c032040 con 0x15983c0 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.247+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/3939961556 >> v2:172.21.15.176:6802/1480150686 conn(0x159e710 0x1632840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.247+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 --> v2:172.21.15.176:6802/1480150686 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x158acc0 con 0x159e710 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.247+0000 7f683979a640 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681403d1c0 0x7f681403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.248+0000 7f683979a640 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681403d1c0 0x7f681403f6d0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.248+0000 7f683a79c640 1 --2- 172.21.15.120:0/3939961556 >> v2:172.21.15.176:6802/1480150686 conn(0x159e710 0x1632840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:27.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.251+0000 7f683a79c640 1 --2- 172.21.15.120:0/3939961556 >> v2:172.21.15.176:6802/1480150686 conn(0x159e710 0x1632840 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f683a79c640 1 -- 172.21.15.120:0/3939961556 <== osd.2 v2:172.21.15.176:6802/1480150686 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f682400c430 con 0x159e710 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 >> v2:172.21.15.176:6802/1480150686 conn(0x159e710 msgr2=0x1632840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/3939961556 >> v2:172.21.15.176:6802/1480150686 conn(0x159e710 0x1632840 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681403d1c0 msgr2=0x7f681403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681403d1c0 0x7f681403f6d0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 msgr2=0x16338c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x16338c0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 shutdown_connections 2024-09-18T13:15:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/3939961556 >> v2:172.21.15.176:6802/1480150686 conn(0x159e710 0x1632840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f681403d1c0 0x7f681403f6d0 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 --2- 172.21.15.120:0/3939961556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x15983c0 0x16338c0 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.265+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 >> 172.21.15.120:0/3939961556 conn(0x142e770 msgr2=0x1599080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.266+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 shutdown_connections 2024-09-18T13:15:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:27.266+0000 7f6841b22ec0 1 -- 172.21.15.120:0/3939961556 wait complete. 2024-09-18T13:15:27.270 INFO:tasks.workunit.client.0.smithi120.stderr:+ sleep 30 2024-09-18T13:15:57.272 INFO:tasks.workunit.client.0.smithi120.stderr:+ rados -p 247c8d9d-0676-4971-be17-81eba57b92bd put threemore /etc/passwd 2024-09-18T13:15:57.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.316+0000 7f62922e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:57.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.321+0000 7f62922e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:57.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.322+0000 7f62922e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:57.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.322+0000 7f62922e7ec0 1 Processor -- start 2024-09-18T13:15:57.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.322+0000 7f62922e7ec0 1 -- start start 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.323+0000 7f62922e7ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1ec5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.323+0000 7f62922e7ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1d11520 con 0x1dad300 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.323+0000 7f628a63f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1ec5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.323+0000 7f628a63f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1ec5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42578/0 (socket says 172.21.15.120:42578) 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.323+0000 7f628a63f640 1 -- 172.21.15.120:0/3297153994 learned_addr learned my addr 172.21.15.120:0/3297153994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.324+0000 7f628a63f640 1 -- 172.21.15.120:0/3297153994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cade10 con 0x1dad300 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.324+0000 7f628a63f640 1 --2- 172.21.15.120:0/3297153994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1ec5590 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939a0782fc6097d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.324+0000 7f6288e3c640 1 -- 172.21.15.120:0/3297153994 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f627402dac0 con 0x1dad300 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.324+0000 7f6288e3c640 1 -- 172.21.15.120:0/3297153994 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f627402dc20 con 0x1dad300 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.324+0000 7f6288e3c640 1 -- 172.21.15.120:0/3297153994 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f627400a170 con 0x1dad300 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3297153994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 msgr2=0x1ec5590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3297153994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1ec5590 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3297153994 shutdown_connections 2024-09-18T13:15:57.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3297153994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1ec5590 unknown :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3297153994 >> 172.21.15.120:0/3297153994 conn(0x1cd1770 msgr2=0x1daf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:57.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3297153994 shutdown_connections 2024-09-18T13:15:57.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3297153994 wait complete. 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 Processor -- start 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.325+0000 7f62922e7ec0 1 -- start start 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.326+0000 7f62922e7ec0 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1e28f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.326+0000 7f62922e7ec0 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x1d0f280 con 0x1dad300 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f628a63f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1e28f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f628a63f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1e28f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42580/0 (socket says 172.21.15.120:42580) 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f628a63f640 1 -- 172.21.15.120:0/3594401013 learned_addr learned my addr 172.21.15.120:0/3594401013 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f628a63f640 1 -- 172.21.15.120:0/3594401013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c9f920 con 0x1dad300 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f628a63f640 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1e28f90 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f6282ffd640 1 -- 172.21.15.120:0/3594401013 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f627403f040 con 0x1dad300 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f6282ffd640 1 -- 172.21.15.120:0/3594401013 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f627403aae0 con 0x1dad300 2024-09-18T13:15:57.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c9f380 con 0x1dad300 2024-09-18T13:15:57.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f6282ffd640 1 -- 172.21.15.120:0/3594401013 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f627403ad80 con 0x1dad300 2024-09-18T13:15:57.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.327+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e2c780 con 0x1dad300 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.328+0000 7f6282ffd640 1 -- 172.21.15.120:0/3594401013 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f62740383e0 con 0x1dad300 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.328+0000 7f6282ffd640 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f627003d1c0 0x7f627003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.328+0000 7f6282ffd640 1 -- 172.21.15.120:0/3594401013 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(717..717 src has 408..717) ==== 4207+0+0 (crc 0 0 0) 0x7f6274032040 con 0x1dad300 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.329+0000 7f6282ffd640 1 -- 172.21.15.120:0/3594401013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7f6270043bf0 con 0x1dad300 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.329+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3594401013 >> v2:172.21.15.120:6803/3478481720 conn(0x1e3fa60 0x1e3bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.329+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 --> v2:172.21.15.120:6803/3478481720 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e717) -- 0x1e2c210 con 0x1e3fa60 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.329+0000 7f6289e3e640 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f627003d1c0 0x7f627003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.329+0000 7f6289e3e640 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f627003d1c0 0x7f627003f6d0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.330+0000 7f628ae40640 1 --2- 172.21.15.120:0/3594401013 >> v2:172.21.15.120:6803/3478481720 conn(0x1e3fa60 0x1e3bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:15:57.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.333+0000 7f628ae40640 1 --2- 172.21.15.120:0/3594401013 >> v2:172.21.15.120:6803/3478481720 conn(0x1e3fa60 0x1e3bd30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f628ae40640 1 -- 172.21.15.120:0/3594401013 <== osd.1 v2:172.21.15.120:6803/3478481720 1 ==== osd_op_reply(1 threemore [writefull 0~12875] v717'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f627c00a430 con 0x1e3fa60 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 >> v2:172.21.15.120:6803/3478481720 conn(0x1e3fa60 msgr2=0x1e3bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3594401013 >> v2:172.21.15.120:6803/3478481720 conn(0x1e3fa60 0x1e3bd30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f627003d1c0 msgr2=0x7f627003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f627003d1c0 0x7f627003f6d0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 msgr2=0x1e28f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1e28f90 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 shutdown_connections 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3594401013 >> v2:172.21.15.120:6803/3478481720 conn(0x1e3fa60 0x1e3bd30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f627003d1c0 0x7f627003f6d0 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 --2- 172.21.15.120:0/3594401013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x1dad300 0x1e28f90 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 >> 172.21.15.120:0/3594401013 conn(0x1cd1770 msgr2=0x1ec5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:57.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 shutdown_connections 2024-09-18T13:15:57.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.348+0000 7f62922e7ec0 1 -- 172.21.15.120:0/3594401013 wait complete. 2024-09-18T13:15:57.351 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota 247c8d9d-0676-4971-be17-81eba57b92bd max_bytes 0 2024-09-18T13:15:57.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.435+0000 7f28038d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:57.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.445+0000 7f28038d1640 1 Processor -- start 2024-09-18T13:15:57.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.445+0000 7f28038d1640 1 -- start start 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f28038d1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f27fc09ed30 0x7f27fc1362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f28038d1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27fc09fd50 con 0x7f27fc136800 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f28038d1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f27fc09fa40 con 0x7f27fc09ed30 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f280166d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f27fc09ed30 0x7f27fc1362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f2800e6c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f27fc136800 0x7f27fc06ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:39426/0 (socket says 172.21.15.120:39426) 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f280166d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f27fc09ed30 0x7f27fc1362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42584/0 (socket says 172.21.15.120:42584) 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f2800e6c640 1 -- 172.21.15.120:0/4241317753 learned_addr learned my addr 172.21.15.120:0/4241317753 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f280166d640 1 -- 172.21.15.120:0/4241317753 >> v1:172.21.15.120:6789/0 conn(0x7f27fc136800 legacy=0x7f27fc06ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:57.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f280166d640 1 -- 172.21.15.120:0/4241317753 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc09ffe0 con 0x7f27fc09ed30 2024-09-18T13:15:57.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.446+0000 7f27f3fff640 1 -- 172.21.15.120:0/4241317753 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396054723 0 0) 0x7f27fc09fd50 con 0x7f27fc136800 2024-09-18T13:15:57.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.447+0000 7f280166d640 1 --2- 172.21.15.120:0/4241317753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc1362c0 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ba4e82f40af46 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:57.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.447+0000 7f27f3fff640 1 -- 172.21.15.120:0/4241317753 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27f8009d90 con 0x7f27fc09ed30 2024-09-18T13:15:57.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.447+0000 7f27f3fff640 1 -- 172.21.15.120:0/4241317753 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27f800e230 con 0x7f27fc09ed30 2024-09-18T13:15:57.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.447+0000 7f27f3fff640 1 -- 172.21.15.120:0/4241317753 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27f800e4d0 con 0x7f27fc09ed30 2024-09-18T13:15:57.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.447+0000 7f28038d1640 1 -- 172.21.15.120:0/4241317753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 msgr2=0x7f27fc1362c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:57.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.447+0000 7f28038d1640 1 --2- 172.21.15.120:0/4241317753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc1362c0 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.448+0000 7f28038d1640 1 -- 172.21.15.120:0/4241317753 shutdown_connections 2024-09-18T13:15:57.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.448+0000 7f28038d1640 1 --2- 172.21.15.120:0/4241317753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc1362c0 unknown :-1 s=CLOSED pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:57.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.448+0000 7f28038d1640 1 -- 172.21.15.120:0/4241317753 >> 172.21.15.120:0/4241317753 conn(0x7f27fc0a5350 msgr2=0x7f27fc0a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:57.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.448+0000 7f28038d1640 1 -- 172.21.15.120:0/4241317753 shutdown_connections 2024-09-18T13:15:57.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.448+0000 7f28038d1640 1 -- 172.21.15.120:0/4241317753 wait complete. 2024-09-18T13:15:57.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.448+0000 7f28038d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:57.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.449+0000 7f28038d1640 1 Processor -- start 2024-09-18T13:15:57.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.449+0000 7f28038d1640 1 -- start start 2024-09-18T13:15:57.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.450+0000 7f28038d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc120a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:57.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.450+0000 7f28038d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc122cf0 con 0x7f27fc09ed30 2024-09-18T13:15:57.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.450+0000 7f280166d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:57.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.450+0000 7f280166d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc120a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42588/0 (socket says 172.21.15.120:42588) 2024-09-18T13:15:57.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.450+0000 7f280166d640 1 -- 172.21.15.120:0/1600719711 learned_addr learned my addr 172.21.15.120:0/1600719711 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:57.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.451+0000 7f280166d640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc124a10 con 0x7f27fc09ed30 2024-09-18T13:15:57.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.451+0000 7f280166d640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc120a00 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:57.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.451+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27f8013610 con 0x7f27fc09ed30 2024-09-18T13:15:57.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.451+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27f8013770 con 0x7f27fc09ed30 2024-09-18T13:15:57.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.451+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc121db0 con 0x7f27fc09ed30 2024-09-18T13:15:57.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.451+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27f8013a10 con 0x7f27fc09ed30 2024-09-18T13:15:57.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.451+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc134cd0 con 0x7f27fc09ed30 2024-09-18T13:15:57.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.452+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27fc1362c0 con 0x7f27fc09ed30 2024-09-18T13:15:57.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.452+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f27f8013bc0 con 0x7f27fc09ed30 2024-09-18T13:15:57.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.452+0000 7f27f1ffb640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f27e003e930 0x7f27e0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:57.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.453+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(717..717 src has 408..717) ==== 4207+0+0 (crc 0 0 0) 0x7f27f8018040 con 0x7f27fc09ed30 2024-09-18T13:15:57.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.453+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7f27e0045360 con 0x7f27fc09ed30 2024-09-18T13:15:57.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.453+0000 7f2800e6c640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f27e003e930 0x7f27e0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:57.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.453+0000 7f2800e6c640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f27e003e930 0x7f27e0040e40 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:57.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.458+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f27f8011570 con 0x7f27fc09ed30 2024-09-18T13:15:57.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:57.639+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"} v 0) -- 0x7f27fc076080 con 0x7f27fc09ed30 2024-09-18T13:15:58.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:58.492+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v718) ==== 217+0+0 (crc 0 0 0) 0x7f27f8018a40 con 0x7f27fc09ed30 2024-09-18T13:15:58.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:58.495+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(718..718 src has 408..718) ==== 628+0+0 (crc 0 0 0) 0x7f27f8012e30 con 0x7f27fc09ed30 2024-09-18T13:15:58.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:58.495+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7f27e0046310 con 0x7f27fc09ed30 2024-09-18T13:15:58.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:58.608+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"} v 0) -- 0x7f27fc123260 con 0x7f27fc09ed30 2024-09-18T13:15:59.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.508+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v719) ==== 217+0+0 (crc 0 0 0) 0x7f27f8017190 con 0x7f27fc09ed30 2024-09-18T13:15:59.509 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_bytes = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:15:59.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f27f1ffb640 1 -- 172.21.15.120:0/1600719711 <== mon.0 v2:172.21.15.120:3300/0 10 ==== osd_map(719..719 src has 408..719) ==== 628+0+0 (crc 0 0 0) 0x7f27f8051260 con 0x7f27fc09ed30 2024-09-18T13:15:59.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f27e003e930 msgr2=0x7f27e0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f27e003e930 0x7f27e0040e40 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 msgr2=0x7f27fc120a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc120a00 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 shutdown_connections 2024-09-18T13:15:59.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f27e003e930 0x7f27e0040e40 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 --2- 172.21.15.120:0/1600719711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27fc09ed30 0x7f27fc120a00 unknown :-1 s=CLOSED pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 >> 172.21.15.120:0/1600719711 conn(0x7f27fc0a5350 msgr2=0x7f27fc0a3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:59.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 shutdown_connections 2024-09-18T13:15:59.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.511+0000 7f28038d1640 1 -- 172.21.15.120:0/1600719711 wait complete. 2024-09-18T13:15:59.531 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool set-quota 247c8d9d-0676-4971-be17-81eba57b92bd max_objects 0 2024-09-18T13:15:59.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.620+0000 7f671fd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:59.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.630+0000 7f671fd11640 1 Processor -- start 2024-09-18T13:15:59.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.630+0000 7f671fd11640 1 -- start start 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.631+0000 7f671fd11640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f67181393c0 0x7f671813b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.631+0000 7f671fd11640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671806dd50 con 0x7f671806e6e0 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.631+0000 7f671fd11640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f671806f200 con 0x7f67181393c0 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.631+0000 7f671d2ac640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f67181393c0 0x7f671813b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.631+0000 7f671daad640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f671806e6e0 0x7f671806eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:39432/0 (socket says 172.21.15.120:39432) 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.631+0000 7f671daad640 1 -- 172.21.15.120:0/4165361165 learned_addr learned my addr 172.21.15.120:0/4165361165 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.632+0000 7f671d2ac640 1 -- 172.21.15.120:0/4165361165 >> v1:172.21.15.120:6789/0 conn(0x7f671806e6e0 legacy=0x7f671806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.632+0000 7f671d2ac640 1 -- 172.21.15.120:0/4165361165 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671806f590 con 0x7f67181393c0 2024-09-18T13:15:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.632+0000 7f671caab640 1 -- 172.21.15.120:0/4165361165 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171184642 0 0) 0x7f671806dd50 con 0x7f671806e6e0 2024-09-18T13:15:59.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.632+0000 7f671d2ac640 1 --2- 172.21.15.120:0/4165361165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67181393c0 0x7f671813b7e0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd23372c519d92e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:59.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.632+0000 7f671caab640 1 -- 172.21.15.120:0/4165361165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6708009d80 con 0x7f67181393c0 2024-09-18T13:15:59.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.632+0000 7f671caab640 1 -- 172.21.15.120:0/4165361165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f670800e230 con 0x7f67181393c0 2024-09-18T13:15:59.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.632+0000 7f671caab640 1 -- 172.21.15.120:0/4165361165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f670800e4d0 con 0x7f67181393c0 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 1 -- 172.21.15.120:0/4165361165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67181393c0 msgr2=0x7f671813b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 1 --2- 172.21.15.120:0/4165361165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67181393c0 0x7f671813b7e0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 1 -- 172.21.15.120:0/4165361165 shutdown_connections 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 1 --2- 172.21.15.120:0/4165361165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67181393c0 0x7f671813b7e0 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 1 -- 172.21.15.120:0/4165361165 >> 172.21.15.120:0/4165361165 conn(0x7f67180a31b0 msgr2=0x7f67180a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 1 -- 172.21.15.120:0/4165361165 shutdown_connections 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 1 -- 172.21.15.120:0/4165361165 wait complete. 2024-09-18T13:15:59.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.633+0000 7f671fd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:15:59.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.634+0000 7f671fd11640 1 Processor -- start 2024-09-18T13:15:59.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.634+0000 7f671fd11640 1 -- start start 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.635+0000 7f671fd11640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671806e6e0 0x7f6718125f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.635+0000 7f671fd11640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f67180a6e40 con 0x7f671806e6e0 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.635+0000 7f671daad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671806e6e0 0x7f6718125f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.635+0000 7f671daad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671806e6e0 0x7f6718125f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42608/0 (socket says 172.21.15.120:42608) 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.635+0000 7f671daad640 1 -- 172.21.15.120:0/104837587 learned_addr learned my addr 172.21.15.120:0/104837587 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.636+0000 7f671daad640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6718125b20 con 0x7f671806e6e0 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.636+0000 7f671daad640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671806e6e0 0x7f6718125f50 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:59.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.636+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6714004b80 con 0x7f671806e6e0 2024-09-18T13:15:59.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.636+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6714004ce0 con 0x7f671806e6e0 2024-09-18T13:15:59.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.636+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6718127140 con 0x7f671806e6e0 2024-09-18T13:15:59.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.636+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6714007120 con 0x7f671806e6e0 2024-09-18T13:15:59.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.636+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6718125810 con 0x7f671806e6e0 2024-09-18T13:15:59.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.637+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6718129590 con 0x7f671806e6e0 2024-09-18T13:15:59.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.637+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6714007320 con 0x7f671806e6e0 2024-09-18T13:15:59.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.637+0000 7f670e7fc640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f66fc03e8e0 0x7f66fc040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:59.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.637+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(719..719 src has 408..719) ==== 4207+0+0 (crc 0 0 0) 0x7f671404fe00 con 0x7f671806e6e0 2024-09-18T13:15:59.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.638+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7f66fc045310 con 0x7f671806e6e0 2024-09-18T13:15:59.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.638+0000 7f671d2ac640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f66fc03e8e0 0x7f66fc040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:59.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.638+0000 7f671d2ac640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f66fc03e8e0 0x7f66fc040df0 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:59.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.643+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f671400f420 con 0x7f671806e6e0 2024-09-18T13:15:59.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:15:59.819+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"} v 0) -- 0x7f671806fe30 con 0x7f671806e6e0 2024-09-18T13:16:00.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:00.518+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v720) ==== 221+0+0 (crc 0 0 0) 0x7f671400a0c0 con 0x7f671806e6e0 2024-09-18T13:16:00.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:00.518+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(720..720 src has 408..720) ==== 628+0+0 (crc 0 0 0) 0x7f67140075d0 con 0x7f671806e6e0 2024-09-18T13:16:00.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:00.518+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7f66fc045cd0 con 0x7f671806e6e0 2024-09-18T13:16:00.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:00.658+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"} v 0) -- 0x7f67180008d0 con 0x7f671806e6e0 2024-09-18T13:16:01.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.523+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd v721) ==== 221+0+0 (crc 0 0 0) 0x7f671400a7b0 con 0x7f671806e6e0 2024-09-18T13:16:01.524 INFO:tasks.workunit.client.0.smithi120.stderr:set-quota max_objects = 0 for pool 247c8d9d-0676-4971-be17-81eba57b92bd 2024-09-18T13:16:01.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.523+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 <== mon.0 v2:172.21.15.120:3300/0 10 ==== osd_map(721..721 src has 408..721) ==== 628+0+0 (crc 0 0 0) 0x7f6714051040 con 0x7f671806e6e0 2024-09-18T13:16:01.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.523+0000 7f670e7fc640 1 -- 172.21.15.120:0/104837587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=722}) -- 0x7f66fc0465c0 con 0x7f671806e6e0 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.527+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f66fc03e8e0 msgr2=0x7f66fc040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.527+0000 7f671fd11640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f66fc03e8e0 0x7f66fc040df0 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.527+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671806e6e0 msgr2=0x7f6718125f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.527+0000 7f671fd11640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671806e6e0 0x7f6718125f50 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.528+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 shutdown_connections 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.528+0000 7f671fd11640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f66fc03e8e0 0x7f66fc040df0 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.528+0000 7f671fd11640 1 --2- 172.21.15.120:0/104837587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f671806e6e0 0x7f6718125f50 unknown :-1 s=CLOSED pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.528+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 >> 172.21.15.120:0/104837587 conn(0x7f67180a31b0 msgr2=0x7f671809ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:01.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.529+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 shutdown_connections 2024-09-18T13:16:01.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:01.529+0000 7f671fd11640 1 -- 172.21.15.120:0/104837587 wait complete. 2024-09-18T13:16:01.543 INFO:tasks.workunit.client.0.smithi120.stderr:+ sleep 30 2024-09-18T13:16:31.545 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool delete 247c8d9d-0676-4971-be17-81eba57b92bd 247c8d9d-0676-4971-be17-81eba57b92bd --yes-i-really-really-mean-it 2024-09-18T13:16:31.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.638+0000 7fbb49791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:31.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.648+0000 7fbb49791640 1 Processor -- start 2024-09-18T13:16:31.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.648+0000 7fbb49791640 1 -- start start 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.649+0000 7fbb49791640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbb4406d9a0 0x7fbb4406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.649+0000 7fbb49791640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb44070460 con 0x7fbb4406e2f0 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.649+0000 7fbb49791640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4406f7e0 con 0x7fbb4406d9a0 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.649+0000 7fbb42ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbb4406d9a0 0x7fbb4406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.649+0000 7fbb3a7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbb4406e2f0 0x7fbb44134300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47646/0 (socket says 172.21.15.120:47646) 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.649+0000 7fbb3a7fc640 1 -- 172.21.15.120:0/978761562 learned_addr learned my addr 172.21.15.120:0/978761562 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.650+0000 7fbb42ffd640 1 -- 172.21.15.120:0/978761562 >> v1:172.21.15.120:6789/0 conn(0x7fbb4406e2f0 legacy=0x7fbb44134300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.650+0000 7fbb42ffd640 1 -- 172.21.15.120:0/978761562 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4406f950 con 0x7fbb4406d9a0 2024-09-18T13:16:31.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.650+0000 7fbb427fc640 1 -- 172.21.15.120:0/978761562 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2613023853 0 0) 0x7fbb44070460 con 0x7fbb4406e2f0 2024-09-18T13:16:31.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.650+0000 7fbb42ffd640 1 --2- 172.21.15.120:0/978761562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4406ddb0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446fc3ddf98a84f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:31.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.650+0000 7fbb427fc640 1 -- 172.21.15.120:0/978761562 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbb34009d90 con 0x7fbb4406d9a0 2024-09-18T13:16:31.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.650+0000 7fbb427fc640 1 -- 172.21.15.120:0/978761562 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbb3400e230 con 0x7fbb4406d9a0 2024-09-18T13:16:31.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.650+0000 7fbb427fc640 1 -- 172.21.15.120:0/978761562 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbb3400e4d0 con 0x7fbb4406d9a0 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 1 -- 172.21.15.120:0/978761562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 msgr2=0x7fbb4406ddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 1 --2- 172.21.15.120:0/978761562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4406ddb0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 1 -- 172.21.15.120:0/978761562 shutdown_connections 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 1 --2- 172.21.15.120:0/978761562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4406ddb0 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 1 -- 172.21.15.120:0/978761562 >> 172.21.15.120:0/978761562 conn(0x7fbb440a30a0 msgr2=0x7fbb440a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 1 -- 172.21.15.120:0/978761562 shutdown_connections 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 1 -- 172.21.15.120:0/978761562 wait complete. 2024-09-18T13:16:31.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.651+0000 7fbb49791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:31.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.652+0000 7fbb49791640 1 Processor -- start 2024-09-18T13:16:31.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.653+0000 7fbb49791640 1 -- start start 2024-09-18T13:16:31.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb49791640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4412f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:31.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb49791640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4412f1a0 con 0x7fbb4406d9a0 2024-09-18T13:16:31.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb42ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4412f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb42ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4412f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60148/0 (socket says 172.21.15.120:60148) 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb42ffd640 1 -- 172.21.15.120:0/4023293567 learned_addr learned my addr 172.21.15.120:0/4023293567 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb42ffd640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb44132f90 con 0x7fbb4406d9a0 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb42ffd640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4412f770 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbb34013610 con 0x7fbb4406d9a0 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbb34013770 con 0x7fbb4406d9a0 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4412f3d0 con 0x7fbb4406d9a0 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbb34013a10 con 0x7fbb4406d9a0 2024-09-18T13:16:31.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.654+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb441322d0 con 0x7fbb4406d9a0 2024-09-18T13:16:31.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.656+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4409f530 con 0x7fbb4406d9a0 2024-09-18T13:16:31.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.656+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbb34013bc0 con 0x7fbb4406d9a0 2024-09-18T13:16:31.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.656+0000 7fbb3bfff640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fbb2403e930 0x7fbb24040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:31.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.656+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(721..721 src has 408..721) ==== 4207+0+0 (crc 0 0 0) 0x7fbb34018040 con 0x7fbb4406d9a0 2024-09-18T13:16:31.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.656+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=722}) -- 0x7fbb24045360 con 0x7fbb4406d9a0 2024-09-18T13:16:31.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.656+0000 7fbb3a7fc640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fbb2403e930 0x7fbb24040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:31.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.657+0000 7fbb3a7fc640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fbb2403e930 0x7fbb24040e40 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:31.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.661+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fbb34011570 con 0x7fbb4406d9a0 2024-09-18T13:16:31.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:31.836+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pool2": "247c8d9d-0676-4971-be17-81eba57b92bd", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbb44077c10 con 0x7fbb4406d9a0 2024-09-18T13:16:32.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.514+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pool2": "247c8d9d-0676-4971-be17-81eba57b92bd", "yes_i_really_really_mean_it": true}]=0 pool '247c8d9d-0676-4971-be17-81eba57b92bd' removed v722) ==== 248+0+0 (crc 0 0 0) 0x7fbb34018bf0 con 0x7fbb4406d9a0 2024-09-18T13:16:32.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.516+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(722..722 src has 408..722) ==== 296+0+0 (crc 0 0 0) 0x7fbb34012e30 con 0x7fbb4406d9a0 2024-09-18T13:16:32.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.516+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7fbb24046080 con 0x7fbb4406d9a0 2024-09-18T13:16:32.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.693+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pool2": "247c8d9d-0676-4971-be17-81eba57b92bd", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbb44132a30 con 0x7fbb4406d9a0 2024-09-18T13:16:32.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.694+0000 7fbb3bfff640 1 -- 172.21.15.120:0/4023293567 <== mon.0 v2:172.21.15.120:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "247c8d9d-0676-4971-be17-81eba57b92bd", "pool2": "247c8d9d-0676-4971-be17-81eba57b92bd", "yes_i_really_really_mean_it": true}]=0 pool '247c8d9d-0676-4971-be17-81eba57b92bd' does not exist v722) ==== 255+0+0 (crc 0 0 0) 0x7fbb34018db0 con 0x7fbb4406d9a0 2024-09-18T13:16:32.695 INFO:tasks.workunit.client.0.smithi120.stderr:pool '247c8d9d-0676-4971-be17-81eba57b92bd' does not exist 2024-09-18T13:16:32.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fbb2403e930 msgr2=0x7fbb24040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:32.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fbb2403e930 0x7fbb24040e40 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:32.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 msgr2=0x7fbb4412f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:32.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4412f770 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:32.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 shutdown_connections 2024-09-18T13:16:32.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fbb2403e930 0x7fbb24040e40 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:32.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 --2- 172.21.15.120:0/4023293567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb4406d9a0 0x7fbb4412f770 unknown :-1 s=CLOSED pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:32.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 >> 172.21.15.120:0/4023293567 conn(0x7fbb440a30a0 msgr2=0x7fbb440723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:32.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 shutdown_connections 2024-09-18T13:16:32.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.696+0000 7fbb49791640 1 -- 172.21.15.120:0/4023293567 wait complete. 2024-09-18T13:16:32.707 INFO:tasks.workunit.client.0.smithi120.stderr:+ ceph osd pool delete e3bcff52-a149-48cc-bb99-cc375a6d277f e3bcff52-a149-48cc-bb99-cc375a6d277f --yes-i-really-really-mean-it 2024-09-18T13:16:32.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.790+0000 7f5a5407f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:32.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.799+0000 7f5a5407f640 1 Processor -- start 2024-09-18T13:16:32.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.800+0000 7f5a5407f640 1 -- start start 2024-09-18T13:16:32.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a5407f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5a4c06d9a0 0x7f5a4c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:32.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a5407f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4c070460 con 0x7f5a4c06e2f0 2024-09-18T13:16:32.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a5407f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5a4c06f7e0 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a51e1b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5a4c06d9a0 0x7f5a4c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a5161a640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5a4c06e2f0 0x7f5a4c134300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47660/0 (socket says 172.21.15.120:47660) 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a5161a640 1 -- 172.21.15.120:0/755786387 learned_addr learned my addr 172.21.15.120:0/755786387 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a51e1b640 1 -- 172.21.15.120:0/755786387 >> v1:172.21.15.120:6789/0 conn(0x7f5a4c06e2f0 legacy=0x7f5a4c134300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a51e1b640 1 -- 172.21.15.120:0/755786387 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c06f950 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a51e1b640 1 --2- 172.21.15.120:0/755786387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c06ddb0 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebee81d6bf660fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a50e19640 1 -- 172.21.15.120:0/755786387 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a4800e040 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a50e19640 1 -- 172.21.15.120:0/755786387 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a48007670 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.801+0000 7f5a50e19640 1 -- 172.21.15.120:0/755786387 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a48007910 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 1 -- 172.21.15.120:0/755786387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 msgr2=0x7f5a4c06ddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 1 --2- 172.21.15.120:0/755786387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c06ddb0 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 1 -- 172.21.15.120:0/755786387 shutdown_connections 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 1 --2- 172.21.15.120:0/755786387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c06ddb0 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 1 -- 172.21.15.120:0/755786387 >> 172.21.15.120:0/755786387 conn(0x7f5a4c0a30a0 msgr2=0x7f5a4c0a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 1 -- 172.21.15.120:0/755786387 shutdown_connections 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 1 -- 172.21.15.120:0/755786387 wait complete. 2024-09-18T13:16:32.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.802+0000 7f5a5407f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:32.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.804+0000 7f5a5407f640 1 Processor -- start 2024-09-18T13:16:32.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.804+0000 7f5a5407f640 1 -- start start 2024-09-18T13:16:32.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a5407f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c12e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:32.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a5407f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c130830 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a51e1b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c12e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a51e1b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c12e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60156/0 (socket says 172.21.15.120:60156) 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a51e1b640 1 -- 172.21.15.120:0/3611484372 learned_addr learned my addr 172.21.15.120:0/3611484372 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a51e1b640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c12f9d0 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a51e1b640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c12e610 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a4800e040 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a48012a80 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c12dfd0 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a48012d20 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.805+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c131ae0 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.806+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c131e20 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.806+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5a480153f0 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.807+0000 7f5a427fc640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a3003e930 0x7f5a30040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:32.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.807+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(722..722 src has 408..722) ==== 3819+0+0 (crc 0 0 0) 0x7f5a480514d0 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.807+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7f5a30044bc0 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.807+0000 7f5a5161a640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a3003e930 0x7f5a30040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:32.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.808+0000 7f5a5161a640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a3003e930 0x7f5a30040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:32.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.812+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f5a48014710 con 0x7f5a4c06d9a0 2024-09-18T13:16:32.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:32.991+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pool2": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5a4c051060 con 0x7f5a4c06d9a0 2024-09-18T13:16:33.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.518+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pool2": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "yes_i_really_really_mean_it": true}]=0 pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' removed v723) ==== 248+0+0 (crc 0 0 0) 0x7f5a4800f210 con 0x7f5a4c06d9a0 2024-09-18T13:16:33.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.519+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(723..723 src has 408..723) ==== 296+0+0 (crc 0 0 0) 0x7f5a48012e80 con 0x7f5a4c06d9a0 2024-09-18T13:16:33.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.519+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7f5a30045780 con 0x7f5a4c06d9a0 2024-09-18T13:16:33.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.694+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pool2": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5a4c12e410 con 0x7f5a4c06d9a0 2024-09-18T13:16:33.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.694+0000 7f5a427fc640 1 -- 172.21.15.120:0/3611484372 <== mon.0 v2:172.21.15.120:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "pool2": "e3bcff52-a149-48cc-bb99-cc375a6d277f", "yes_i_really_really_mean_it": true}]=0 pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' does not exist v723) ==== 255+0+0 (crc 0 0 0) 0x7f5a4800e1a0 con 0x7f5a4c06d9a0 2024-09-18T13:16:33.696 INFO:tasks.workunit.client.0.smithi120.stderr:pool 'e3bcff52-a149-48cc-bb99-cc375a6d277f' does not exist 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a3003e930 msgr2=0x7f5a30040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a3003e930 0x7f5a30040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 msgr2=0x7f5a4c12e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c12e610 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 shutdown_connections 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f5a3003e930 0x7f5a30040e40 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 --2- 172.21.15.120:0/3611484372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a4c06d9a0 0x7f5a4c12e610 unknown :-1 s=CLOSED pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 >> 172.21.15.120:0/3611484372 conn(0x7f5a4c0a30a0 msgr2=0x7f5a4c09faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:33.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 shutdown_connections 2024-09-18T13:16:33.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-18T13:16:33.697+0000 7f5a5407f640 1 -- 172.21.15.120:0/3611484372 wait complete. 2024-09-18T13:16:33.707 INFO:tasks.workunit.client.0.smithi120.stdout:OK 2024-09-18T13:16:33.708 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo OK 2024-09-18T13:16:33.709 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T13:16:33.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T13:16:33.774 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-18T13:16:33.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-18T13:16:34.092 DEBUG:teuthology.parallel:result is None 2024-09-18T13:16:34.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T13:16:34.117 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T13:16:34.117 DEBUG:teuthology.orchestra.run.smithi120:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-18T13:16:34.263 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T13:16:34.264 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T13:16:34.273 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T13:16:34.273 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:16:34.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.376+0000 7f4034991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:34.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.381+0000 7f4034991640 1 Processor -- start 2024-09-18T13:16:34.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.381+0000 7f4034991640 1 -- start start 2024-09-18T13:16:34.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.382+0000 7f4034991640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f403009d7a0 0x7f4030133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:34.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.382+0000 7f4034991640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40300a24b0 con 0x7f4030134220 2024-09-18T13:16:34.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.382+0000 7f4034991640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f403009dfc0 con 0x7f403009d7a0 2024-09-18T13:16:34.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.382+0000 7f402e59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f403009d7a0 0x7f4030133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.382+0000 7f402dd9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4030134220 0x7f4030130a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47674/0 (socket says 172.21.15.120:47674) 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.382+0000 7f402dd9b640 1 -- 172.21.15.120:0/3928990723 learned_addr learned my addr 172.21.15.120:0/3928990723 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.383+0000 7f402e59c640 1 -- 172.21.15.120:0/3928990723 >> v1:172.21.15.120:6789/0 conn(0x7f4030134220 legacy=0x7f4030130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.383+0000 7f402e59c640 1 -- 172.21.15.120:0/3928990723 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403009dcb0 con 0x7f403009d7a0 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.383+0000 7f402d59a640 1 -- 172.21.15.120:0/3928990723 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255437938 0 0) 0x7f40300a24b0 con 0x7f4030134220 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.383+0000 7f402e59c640 1 --2- 172.21.15.120:0/3928990723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f4030133ce0 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46c79b309a47c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.383+0000 7f402d59a640 1 -- 172.21.15.120:0/3928990723 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4020009d90 con 0x7f403009d7a0 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.383+0000 7f402d59a640 1 -- 172.21.15.120:0/3928990723 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f402000e230 con 0x7f403009d7a0 2024-09-18T13:16:34.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.383+0000 7f402d59a640 1 -- 172.21.15.120:0/3928990723 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f402000e4d0 con 0x7f403009d7a0 2024-09-18T13:16:34.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 1 -- 172.21.15.120:0/3928990723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 msgr2=0x7f4030133ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 1 --2- 172.21.15.120:0/3928990723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f4030133ce0 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 1 -- 172.21.15.120:0/3928990723 shutdown_connections 2024-09-18T13:16:34.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 1 --2- 172.21.15.120:0/3928990723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f4030133ce0 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 1 -- 172.21.15.120:0/3928990723 >> 172.21.15.120:0/3928990723 conn(0x7f40300a3140 msgr2=0x7f40300a3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:34.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 1 -- 172.21.15.120:0/3928990723 shutdown_connections 2024-09-18T13:16:34.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 1 -- 172.21.15.120:0/3928990723 wait complete. 2024-09-18T13:16:34.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.384+0000 7f4034991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.386+0000 7f4034991640 1 Processor -- start 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.386+0000 7f4034991640 1 -- start start 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f4034991640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f403011ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f4034991640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f403011e4c0 con 0x7f403009d7a0 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f402e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f403011ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f402e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f403011ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60180/0 (socket says 172.21.15.120:60180) 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f402e59c640 1 -- 172.21.15.120:0/2381277987 learned_addr learned my addr 172.21.15.120:0/2381277987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f402e59c640 1 -- 172.21.15.120:0/2381277987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403011ea50 con 0x7f403009d7a0 2024-09-18T13:16:34.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f402e59c640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f403011ee10 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:34.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f401effd640 1 -- 172.21.15.120:0/2381277987 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4020014620 con 0x7f403009d7a0 2024-09-18T13:16:34.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f401effd640 1 -- 172.21.15.120:0/2381277987 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4020014780 con 0x7f403009d7a0 2024-09-18T13:16:34.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f401effd640 1 -- 172.21.15.120:0/2381277987 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4020014a20 con 0x7f403009d7a0 2024-09-18T13:16:34.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4030120870 con 0x7f403009d7a0 2024-09-18T13:16:34.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.387+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4030121f10 con 0x7f403009d7a0 2024-09-18T13:16:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.388+0000 7f401effd640 1 -- 172.21.15.120:0/2381277987 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4020014bd0 con 0x7f403009d7a0 2024-09-18T13:16:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.389+0000 7f401effd640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f401003e930 0x7f4010040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.389+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4030122240 con 0x7f403009d7a0 2024-09-18T13:16:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.389+0000 7f401effd640 1 -- 172.21.15.120:0/2381277987 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f4020019040 con 0x7f403009d7a0 2024-09-18T13:16:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.389+0000 7f402dd9b640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f401003e930 0x7f4010040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.389+0000 7f402dd9b640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f401003e930 0x7f4010040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:34.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.394+0000 7f401effd640 1 -- 172.21.15.120:0/2381277987 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f4020011570 con 0x7f403009d7a0 2024-09-18T13:16:34.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.566+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f403011e850 con 0x7f401003e930 2024-09-18T13:16:34.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.569+0000 7f401effd640 1 -- 172.21.15.120:0/2381277987 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109018 (crc 0 0 0) 0x7f403011e850 con 0x7f401003e930 2024-09-18T13:16:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T13:16:34.572 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T13:16:34.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.571+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f401003e930 msgr2=0x7f4010040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.571+0000 7f4034991640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f401003e930 0x7f4010040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 msgr2=0x7f403011ee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f403011ee10 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 shutdown_connections 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f401003e930 0x7f4010040e40 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 --2- 172.21.15.120:0/2381277987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f403009d7a0 0x7f403011ee10 unknown :-1 s=CLOSED pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 >> 172.21.15.120:0/2381277987 conn(0x7f40300a3140 msgr2=0x7f40300a4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 shutdown_connections 2024-09-18T13:16:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.572+0000 7f4034991640 1 -- 172.21.15.120:0/2381277987 wait complete. 2024-09-18T13:16:34.584 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1283,"stamp":"2024-09-18T13:16:33.520340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":242208,"kb_used_data":14112,"kb_used_omap":0,"kb_used_meta":228032,"kb_avail":377245152,"statfs":{"total":386547056640,"available":386299035648,"internally_reserved":0,"allocated":14450688,"data_stored":7082822,"data_compressed":354470,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":233504768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.685963"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552988+0000","last_change":"2024-09-18T13:02:43.599349+0000","last_active":"2024-09-18T13:16:01.552988+0000","last_peered":"2024-09-18T13:16:01.552988+0000","last_clean":"2024-09-18T13:16:01.552988+0000","last_became_active":"2024-09-18T13:02:43.590588+0000","last_became_peered":"2024-09-18T13:02:43.590588+0000","last_unstale":"2024-09-18T13:16:01.552988+0000","last_undegraded":"2024-09-18T13:16:01.552988+0000","last_fullsized":"2024-09-18T13:16:01.552988+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543414+0000","last_change":"2024-09-18T13:02:43.498337+0000","last_active":"2024-09-18T13:16:01.543414+0000","last_peered":"2024-09-18T13:16:01.543414+0000","last_clean":"2024-09-18T13:16:01.543414+0000","last_became_active":"2024-09-18T13:02:43.486897+0000","last_became_peered":"2024-09-18T13:02:43.486897+0000","last_unstale":"2024-09-18T13:16:01.543414+0000","last_undegraded":"2024-09-18T13:16:01.543414+0000","last_fullsized":"2024-09-18T13:16:01.543414+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550088+0000","last_change":"2024-09-18T13:02:43.540031+0000","last_active":"2024-09-18T13:16:01.550088+0000","last_peered":"2024-09-18T13:16:01.550088+0000","last_clean":"2024-09-18T13:16:01.550088+0000","last_became_active":"2024-09-18T13:02:43.532857+0000","last_became_peered":"2024-09-18T13:02:43.532857+0000","last_unstale":"2024-09-18T13:16:01.550088+0000","last_undegraded":"2024-09-18T13:16:01.550088+0000","last_fullsized":"2024-09-18T13:16:01.550088+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.540903+0000","last_change":"2024-09-18T13:02:43.533350+0000","last_active":"2024-09-18T13:16:01.540903+0000","last_peered":"2024-09-18T13:16:01.540903+0000","last_clean":"2024-09-18T13:16:01.540903+0000","last_became_active":"2024-09-18T13:02:43.511170+0000","last_became_peered":"2024-09-18T13:02:43.511170+0000","last_unstale":"2024-09-18T13:16:01.540903+0000","last_undegraded":"2024-09-18T13:16:01.540903+0000","last_fullsized":"2024-09-18T13:16:01.540903+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553782+0000","last_change":"2024-09-18T13:02:43.540161+0000","last_active":"2024-09-18T13:16:01.553782+0000","last_peered":"2024-09-18T13:16:01.553782+0000","last_clean":"2024-09-18T13:16:01.553782+0000","last_became_active":"2024-09-18T13:02:43.530098+0000","last_became_peered":"2024-09-18T13:02:43.530098+0000","last_unstale":"2024-09-18T13:16:01.553782+0000","last_undegraded":"2024-09-18T13:16:01.553782+0000","last_fullsized":"2024-09-18T13:16:01.553782+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556066+0000","last_change":"2024-09-18T13:02:43.596587+0000","last_active":"2024-09-18T13:16:01.556066+0000","last_peered":"2024-09-18T13:16:01.556066+0000","last_clean":"2024-09-18T13:16:01.556066+0000","last_became_active":"2024-09-18T13:02:43.586094+0000","last_became_peered":"2024-09-18T13:02:43.586094+0000","last_unstale":"2024-09-18T13:16:01.556066+0000","last_undegraded":"2024-09-18T13:16:01.556066+0000","last_fullsized":"2024-09-18T13:16:01.556066+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550582+0000","last_change":"2024-09-18T13:02:43.489572+0000","last_active":"2024-09-18T13:16:01.550582+0000","last_peered":"2024-09-18T13:16:01.550582+0000","last_clean":"2024-09-18T13:16:01.550582+0000","last_became_active":"2024-09-18T13:02:43.485079+0000","last_became_peered":"2024-09-18T13:02:43.485079+0000","last_unstale":"2024-09-18T13:16:01.550582+0000","last_undegraded":"2024-09-18T13:16:01.550582+0000","last_fullsized":"2024-09-18T13:16:01.550582+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.546093+0000","last_change":"2024-09-18T13:02:43.460695+0000","last_active":"2024-09-18T13:16:01.546093+0000","last_peered":"2024-09-18T13:16:01.546093+0000","last_clean":"2024-09-18T13:16:01.546093+0000","last_became_active":"2024-09-18T13:02:43.449840+0000","last_became_peered":"2024-09-18T13:02:43.449840+0000","last_unstale":"2024-09-18T13:16:01.546093+0000","last_undegraded":"2024-09-18T13:16:01.546093+0000","last_fullsized":"2024-09-18T13:16:01.546093+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552165+0000","last_change":"2024-09-18T13:02:43.561872+0000","last_active":"2024-09-18T13:16:01.552165+0000","last_peered":"2024-09-18T13:16:01.552165+0000","last_clean":"2024-09-18T13:16:01.552165+0000","last_became_active":"2024-09-18T13:02:43.556273+0000","last_became_peered":"2024-09-18T13:02:43.556273+0000","last_unstale":"2024-09-18T13:16:01.552165+0000","last_undegraded":"2024-09-18T13:16:01.552165+0000","last_fullsized":"2024-09-18T13:16:01.552165+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.561062+0000","last_change":"2024-09-18T13:02:43.570131+0000","last_active":"2024-09-18T13:16:01.561062+0000","last_peered":"2024-09-18T13:16:01.561062+0000","last_clean":"2024-09-18T13:16:01.561062+0000","last_became_active":"2024-09-18T13:02:43.560225+0000","last_became_peered":"2024-09-18T13:02:43.560225+0000","last_unstale":"2024-09-18T13:16:01.561062+0000","last_undegraded":"2024-09-18T13:16:01.561062+0000","last_fullsized":"2024-09-18T13:16:01.561062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551843+0000","last_change":"2024-09-18T13:02:43.436362+0000","last_active":"2024-09-18T13:16:01.551843+0000","last_peered":"2024-09-18T13:16:01.551843+0000","last_clean":"2024-09-18T13:16:01.551843+0000","last_became_active":"2024-09-18T13:02:43.423644+0000","last_became_peered":"2024-09-18T13:02:43.423644+0000","last_unstale":"2024-09-18T13:16:01.551843+0000","last_undegraded":"2024-09-18T13:16:01.551843+0000","last_fullsized":"2024-09-18T13:16:01.551843+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547337+0000","last_change":"2024-09-18T13:02:43.535591+0000","last_active":"2024-09-18T13:16:01.547337+0000","last_peered":"2024-09-18T13:16:01.547337+0000","last_clean":"2024-09-18T13:16:01.547337+0000","last_became_active":"2024-09-18T13:02:43.524825+0000","last_became_peered":"2024-09-18T13:02:43.524825+0000","last_unstale":"2024-09-18T13:16:01.547337+0000","last_undegraded":"2024-09-18T13:16:01.547337+0000","last_fullsized":"2024-09-18T13:16:01.547337+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.560376+0000","last_change":"2024-09-18T13:02:43.582811+0000","last_active":"2024-09-18T13:16:01.560376+0000","last_peered":"2024-09-18T13:16:01.560376+0000","last_clean":"2024-09-18T13:16:01.560376+0000","last_became_active":"2024-09-18T13:02:43.571390+0000","last_became_peered":"2024-09-18T13:02:43.571390+0000","last_unstale":"2024-09-18T13:16:01.560376+0000","last_undegraded":"2024-09-18T13:16:01.560376+0000","last_fullsized":"2024-09-18T13:16:01.560376+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.545464+0000","last_change":"2024-09-18T13:02:43.526115+0000","last_active":"2024-09-18T13:16:01.545464+0000","last_peered":"2024-09-18T13:16:01.545464+0000","last_clean":"2024-09-18T13:16:01.545464+0000","last_became_active":"2024-09-18T13:02:43.504340+0000","last_became_peered":"2024-09-18T13:02:43.504340+0000","last_unstale":"2024-09-18T13:16:01.545464+0000","last_undegraded":"2024-09-18T13:16:01.545464+0000","last_fullsized":"2024-09-18T13:16:01.545464+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558435+0000","last_change":"2024-09-18T13:02:43.576863+0000","last_active":"2024-09-18T13:16:01.558435+0000","last_peered":"2024-09-18T13:16:01.558435+0000","last_clean":"2024-09-18T13:16:01.558435+0000","last_became_active":"2024-09-18T13:02:43.568592+0000","last_became_peered":"2024-09-18T13:02:43.568592+0000","last_unstale":"2024-09-18T13:16:01.558435+0000","last_undegraded":"2024-09-18T13:16:01.558435+0000","last_fullsized":"2024-09-18T13:16:01.558435+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.541033+0000","last_change":"2024-09-18T13:02:43.498554+0000","last_active":"2024-09-18T13:16:01.541033+0000","last_peered":"2024-09-18T13:16:01.541033+0000","last_clean":"2024-09-18T13:16:01.541033+0000","last_became_active":"2024-09-18T13:02:43.492774+0000","last_became_peered":"2024-09-18T13:02:43.492774+0000","last_unstale":"2024-09-18T13:16:01.541033+0000","last_undegraded":"2024-09-18T13:16:01.541033+0000","last_fullsized":"2024-09-18T13:16:01.541033+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549649+0000","last_change":"2024-09-18T13:02:43.534935+0000","last_active":"2024-09-18T13:16:01.549649+0000","last_peered":"2024-09-18T13:16:01.549649+0000","last_clean":"2024-09-18T13:16:01.549649+0000","last_became_active":"2024-09-18T13:02:43.523232+0000","last_became_peered":"2024-09-18T13:02:43.523232+0000","last_unstale":"2024-09-18T13:16:01.549649+0000","last_undegraded":"2024-09-18T13:16:01.549649+0000","last_fullsized":"2024-09-18T13:16:01.549649+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551968+0000","last_change":"2024-09-18T13:02:43.576965+0000","last_active":"2024-09-18T13:16:01.551968+0000","last_peered":"2024-09-18T13:16:01.551968+0000","last_clean":"2024-09-18T13:16:01.551968+0000","last_became_active":"2024-09-18T13:02:43.565270+0000","last_became_peered":"2024-09-18T13:02:43.565270+0000","last_unstale":"2024-09-18T13:16:01.551968+0000","last_undegraded":"2024-09-18T13:16:01.551968+0000","last_fullsized":"2024-09-18T13:16:01.551968+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.539268+0000","last_change":"2024-09-18T13:02:43.489078+0000","last_active":"2024-09-18T13:16:01.539268+0000","last_peered":"2024-09-18T13:16:01.539268+0000","last_clean":"2024-09-18T13:16:01.539268+0000","last_became_active":"2024-09-18T13:02:43.475127+0000","last_became_peered":"2024-09-18T13:02:43.475127+0000","last_unstale":"2024-09-18T13:16:01.539268+0000","last_undegraded":"2024-09-18T13:16:01.539268+0000","last_fullsized":"2024-09-18T13:16:01.539268+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550254+0000","last_change":"2024-09-18T13:02:43.518460+0000","last_active":"2024-09-18T13:16:01.550254+0000","last_peered":"2024-09-18T13:16:01.550254+0000","last_clean":"2024-09-18T13:16:01.550254+0000","last_became_active":"2024-09-18T13:02:43.511706+0000","last_became_peered":"2024-09-18T13:02:43.511706+0000","last_unstale":"2024-09-18T13:16:01.550254+0000","last_undegraded":"2024-09-18T13:16:01.550254+0000","last_fullsized":"2024-09-18T13:16:01.550254+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557095+0000","last_change":"2024-09-18T13:02:43.547134+0000","last_active":"2024-09-18T13:16:01.557095+0000","last_peered":"2024-09-18T13:16:01.557095+0000","last_clean":"2024-09-18T13:16:01.557095+0000","last_became_active":"2024-09-18T13:02:43.540420+0000","last_became_peered":"2024-09-18T13:02:43.540420+0000","last_unstale":"2024-09-18T13:16:01.557095+0000","last_undegraded":"2024-09-18T13:16:01.557095+0000","last_fullsized":"2024-09-18T13:16:01.557095+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.548178+0000","last_change":"2024-09-18T13:02:43.513580+0000","last_active":"2024-09-18T13:16:01.548178+0000","last_peered":"2024-09-18T13:16:01.548178+0000","last_clean":"2024-09-18T13:16:01.548178+0000","last_became_active":"2024-09-18T13:02:43.506008+0000","last_became_peered":"2024-09-18T13:02:43.506008+0000","last_unstale":"2024-09-18T13:16:01.548178+0000","last_undegraded":"2024-09-18T13:16:01.548178+0000","last_fullsized":"2024-09-18T13:16:01.548178+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558001+0000","last_change":"2024-09-18T13:02:43.551512+0000","last_active":"2024-09-18T13:16:01.558001+0000","last_peered":"2024-09-18T13:16:01.558001+0000","last_clean":"2024-09-18T13:16:01.558001+0000","last_became_active":"2024-09-18T13:02:43.544809+0000","last_became_peered":"2024-09-18T13:02:43.544809+0000","last_unstale":"2024-09-18T13:16:01.558001+0000","last_undegraded":"2024-09-18T13:16:01.558001+0000","last_fullsized":"2024-09-18T13:16:01.558001+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553523+0000","last_change":"2024-09-18T13:02:43.552029+0000","last_active":"2024-09-18T13:16:01.553523+0000","last_peered":"2024-09-18T13:16:01.553523+0000","last_clean":"2024-09-18T13:16:01.553523+0000","last_became_active":"2024-09-18T13:02:43.532465+0000","last_became_peered":"2024-09-18T13:02:43.532465+0000","last_unstale":"2024-09-18T13:16:01.553523+0000","last_undegraded":"2024-09-18T13:16:01.553523+0000","last_fullsized":"2024-09-18T13:16:01.553523+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557180+0000","last_change":"2024-09-18T13:02:43.548538+0000","last_active":"2024-09-18T13:16:01.557180+0000","last_peered":"2024-09-18T13:16:01.557180+0000","last_clean":"2024-09-18T13:16:01.557180+0000","last_became_active":"2024-09-18T13:02:43.540114+0000","last_became_peered":"2024-09-18T13:02:43.540114+0000","last_unstale":"2024-09-18T13:16:01.557180+0000","last_undegraded":"2024-09-18T13:16:01.557180+0000","last_fullsized":"2024-09-18T13:16:01.557180+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556568+0000","last_change":"2024-09-18T13:02:43.528988+0000","last_active":"2024-09-18T13:16:01.556568+0000","last_peered":"2024-09-18T13:16:01.556568+0000","last_clean":"2024-09-18T13:16:01.556568+0000","last_became_active":"2024-09-18T13:02:43.519357+0000","last_became_peered":"2024-09-18T13:02:43.519357+0000","last_unstale":"2024-09-18T13:16:01.556568+0000","last_undegraded":"2024-09-18T13:16:01.556568+0000","last_fullsized":"2024-09-18T13:16:01.556568+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547849+0000","last_change":"2024-09-18T13:02:43.540324+0000","last_active":"2024-09-18T13:16:01.547849+0000","last_peered":"2024-09-18T13:16:01.547849+0000","last_clean":"2024-09-18T13:16:01.547849+0000","last_became_active":"2024-09-18T13:02:43.517545+0000","last_became_peered":"2024-09-18T13:02:43.517545+0000","last_unstale":"2024-09-18T13:16:01.547849+0000","last_undegraded":"2024-09-18T13:16:01.547849+0000","last_fullsized":"2024-09-18T13:16:01.547849+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549190+0000","last_change":"2024-09-18T13:02:43.479354+0000","last_active":"2024-09-18T13:16:01.549190+0000","last_peered":"2024-09-18T13:16:01.549190+0000","last_clean":"2024-09-18T13:16:01.549190+0000","last_became_active":"2024-09-18T13:02:43.467457+0000","last_became_peered":"2024-09-18T13:02:43.467457+0000","last_unstale":"2024-09-18T13:16:01.549190+0000","last_undegraded":"2024-09-18T13:16:01.549190+0000","last_fullsized":"2024-09-18T13:16:01.549190+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549054+0000","last_change":"2024-09-18T13:02:43.593763+0000","last_active":"2024-09-18T13:16:01.549054+0000","last_peered":"2024-09-18T13:16:01.549054+0000","last_clean":"2024-09-18T13:16:01.549054+0000","last_became_active":"2024-09-18T13:02:43.582192+0000","last_became_peered":"2024-09-18T13:02:43.582192+0000","last_unstale":"2024-09-18T13:16:01.549054+0000","last_undegraded":"2024-09-18T13:16:01.549054+0000","last_fullsized":"2024-09-18T13:16:01.549054+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551277+0000","last_change":"2024-09-18T13:02:43.562670+0000","last_active":"2024-09-18T13:16:01.551277+0000","last_peered":"2024-09-18T13:16:01.551277+0000","last_clean":"2024-09-18T13:16:01.551277+0000","last_became_active":"2024-09-18T13:02:43.550918+0000","last_became_peered":"2024-09-18T13:02:43.550918+0000","last_unstale":"2024-09-18T13:16:01.551277+0000","last_undegraded":"2024-09-18T13:16:01.551277+0000","last_fullsized":"2024-09-18T13:16:01.551277+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1467,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555073+0000","last_change":"2024-09-18T13:02:43.574240+0000","last_active":"2024-09-18T13:16:01.555073+0000","last_peered":"2024-09-18T13:16:01.555073+0000","last_clean":"2024-09-18T13:16:01.555073+0000","last_became_active":"2024-09-18T13:02:43.562324+0000","last_became_peered":"2024-09-18T13:02:43.562324+0000","last_unstale":"2024-09-18T13:16:01.555073+0000","last_undegraded":"2024-09-18T13:16:01.555073+0000","last_fullsized":"2024-09-18T13:16:01.555073+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.562621+0000","last_change":"2024-09-18T13:02:43.573284+0000","last_active":"2024-09-18T13:16:01.562621+0000","last_peered":"2024-09-18T13:16:01.562621+0000","last_clean":"2024-09-18T13:16:01.562621+0000","last_became_active":"2024-09-18T13:02:43.564846+0000","last_became_peered":"2024-09-18T13:02:43.564846+0000","last_unstale":"2024-09-18T13:16:01.562621+0000","last_undegraded":"2024-09-18T13:16:01.562621+0000","last_fullsized":"2024-09-18T13:16:01.562621+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544929+0000","last_change":"2024-09-18T12:57:44.682637+0000","last_active":"2024-09-18T13:16:01.544929+0000","last_peered":"2024-09-18T13:16:01.544929+0000","last_clean":"2024-09-18T13:16:01.544929+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T13:16:01.544929+0000","last_undegraded":"2024-09-18T13:16:01.544929+0000","last_fullsized":"2024-09-18T13:16:01.544929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555327+0000","last_change":"2024-09-18T12:57:44.684106+0000","last_active":"2024-09-18T13:16:01.555327+0000","last_peered":"2024-09-18T13:16:01.555327+0000","last_clean":"2024-09-18T13:16:01.555327+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T13:16:01.555327+0000","last_undegraded":"2024-09-18T13:16:01.555327+0000","last_fullsized":"2024-09-18T13:16:01.555327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.538460+0000","last_change":"2024-09-18T12:57:44.680252+0000","last_active":"2024-09-18T13:16:01.538460+0000","last_peered":"2024-09-18T13:16:01.538460+0000","last_clean":"2024-09-18T13:16:01.538460+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T13:16:01.538460+0000","last_undegraded":"2024-09-18T13:16:01.538460+0000","last_fullsized":"2024-09-18T13:16:01.538460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552778+0000","last_change":"2024-09-18T12:57:44.684632+0000","last_active":"2024-09-18T13:16:01.552778+0000","last_peered":"2024-09-18T13:16:01.552778+0000","last_clean":"2024-09-18T13:16:01.552778+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T13:16:01.552778+0000","last_undegraded":"2024-09-18T13:16:01.552778+0000","last_fullsized":"2024-09-18T13:16:01.552778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":2132,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550279+0000","last_change":"2024-09-18T12:57:44.684900+0000","last_active":"2024-09-18T13:16:01.550279+0000","last_peered":"2024-09-18T13:16:01.550279+0000","last_clean":"2024-09-18T13:16:01.550279+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T13:16:01.550279+0000","last_undegraded":"2024-09-18T13:16:01.550279+0000","last_fullsized":"2024-09-18T13:16:01.550279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552368+0000","last_change":"2024-09-18T12:57:44.684570+0000","last_active":"2024-09-18T13:16:01.552368+0000","last_peered":"2024-09-18T13:16:01.552368+0000","last_clean":"2024-09-18T13:16:01.552368+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T13:16:01.552368+0000","last_undegraded":"2024-09-18T13:16:01.552368+0000","last_fullsized":"2024-09-18T13:16:01.552368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543981+0000","last_change":"2024-09-18T12:57:44.682925+0000","last_active":"2024-09-18T13:16:01.543981+0000","last_peered":"2024-09-18T13:16:01.543981+0000","last_clean":"2024-09-18T13:16:01.543981+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T13:16:01.543981+0000","last_undegraded":"2024-09-18T13:16:01.543981+0000","last_fullsized":"2024-09-18T13:16:01.543981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":2131,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555285+0000","last_change":"2024-09-18T12:57:44.685288+0000","last_active":"2024-09-18T13:16:01.555285+0000","last_peered":"2024-09-18T13:16:01.555285+0000","last_clean":"2024-09-18T13:16:01.555285+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T13:16:01.555285+0000","last_undegraded":"2024-09-18T13:16:01.555285+0000","last_fullsized":"2024-09-18T13:16:01.555285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2205,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544207+0000","last_change":"2024-09-18T12:57:39.686575+0000","last_active":"2024-09-18T13:16:01.544207+0000","last_peered":"2024-09-18T13:16:01.544207+0000","last_clean":"2024-09-18T13:16:01.544207+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T13:16:01.544207+0000","last_undegraded":"2024-09-18T13:16:01.544207+0000","last_fullsized":"2024-09-18T13:16:01.544207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48364,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94323476,"statfs":{"total":96636764160,"available":96587239424,"internally_reserved":0,"allocated":3567616,"data_stored":1456221,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66512,"kb_used_data":3584,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305328,"statfs":{"total":96636764160,"available":96568655872,"internally_reserved":0,"allocated":3670016,"data_stored":2098065,"data_compressed":118355,"data_compressed_allocated":163840,"data_compressed_original":757760,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66480,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305360,"statfs":{"total":96636764160,"available":96568688640,"internally_reserved":0,"allocated":3637248,"data_stored":2059459,"data_compressed":100691,"data_compressed_allocated":139264,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60852,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310988,"statfs":{"total":96636764160,"available":96574451712,"internally_reserved":0,"allocated":3575808,"data_stored":1469077,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:16:34.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:16:34.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.689+0000 7f60ddf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:34.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.693+0000 7f60ddf91640 1 Processor -- start 2024-09-18T13:16:34.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.694+0000 7f60ddf91640 1 -- start start 2024-09-18T13:16:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60ddf91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f60d809e910 0x7f60d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60ddf91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d806d370 con 0x7f60d809f040 2024-09-18T13:16:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60ddf91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f60d8070cb0 con 0x7f60d809e910 2024-09-18T13:16:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d6ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f60d809e910 0x7f60d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d77fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f60d809f040 0x7f60d8068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47686/0 (socket says 172.21.15.120:47686) 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d77fe640 1 -- 172.21.15.120:0/2013217590 learned_addr learned my addr 172.21.15.120:0/2013217590 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d6ffd640 1 -- 172.21.15.120:0/2013217590 >> v1:172.21.15.120:6789/0 conn(0x7f60d809f040 legacy=0x7f60d8068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d67fc640 1 -- 172.21.15.120:0/2013217590 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480008827 0 0) 0x7f60d806d370 con 0x7f60d809f040 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d6ffd640 1 -- 172.21.15.120:0/2013217590 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d809c1c0 con 0x7f60d809e910 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d6ffd640 1 --2- 172.21.15.120:0/2013217590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d8069450 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf418f68755952ca server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d67fc640 1 -- 172.21.15.120:0/2013217590 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60cc009d90 con 0x7f60d809e910 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d67fc640 1 -- 172.21.15.120:0/2013217590 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f60cc00e230 con 0x7f60d809e910 2024-09-18T13:16:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.695+0000 7f60d67fc640 1 -- 172.21.15.120:0/2013217590 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60cc00e4d0 con 0x7f60d809e910 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 1 -- 172.21.15.120:0/2013217590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 msgr2=0x7f60d8069450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 1 --2- 172.21.15.120:0/2013217590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d8069450 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 1 -- 172.21.15.120:0/2013217590 shutdown_connections 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 1 --2- 172.21.15.120:0/2013217590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d8069450 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 1 -- 172.21.15.120:0/2013217590 >> 172.21.15.120:0/2013217590 conn(0x7f60d80a32a0 msgr2=0x7f60d80a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 1 -- 172.21.15.120:0/2013217590 shutdown_connections 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 1 -- 172.21.15.120:0/2013217590 wait complete. 2024-09-18T13:16:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.696+0000 7f60ddf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.698+0000 7f60ddf91640 1 Processor -- start 2024-09-18T13:16:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.698+0000 7f60ddf91640 1 -- start start 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.699+0000 7f60ddf91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.699+0000 7f60ddf91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f60d8071790 con 0x7f60d809e910 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.699+0000 7f60d77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.699+0000 7f60d77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d809a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60204/0 (socket says 172.21.15.120:60204) 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.699+0000 7f60d77fe640 1 -- 172.21.15.120:0/3116902973 learned_addr learned my addr 172.21.15.120:0/3116902973 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.699+0000 7f60d77fe640 1 -- 172.21.15.120:0/3116902973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d8075020 con 0x7f60d809e910 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.699+0000 7f60d77fe640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d809a400 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.700+0000 7f60bffff640 1 -- 172.21.15.120:0/3116902973 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60c8005a60 con 0x7f60d809e910 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.700+0000 7f60bffff640 1 -- 172.21.15.120:0/3116902973 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f60c8005bc0 con 0x7f60d809e910 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.700+0000 7f60bffff640 1 -- 172.21.15.120:0/3116902973 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60c8005e60 con 0x7f60d809e910 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.700+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d809bdb0 con 0x7f60d809e910 2024-09-18T13:16:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.700+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d809d910 con 0x7f60d809e910 2024-09-18T13:16:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.701+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d8068d40 con 0x7f60d809e910 2024-09-18T13:16:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.701+0000 7f60bffff640 1 -- 172.21.15.120:0/3116902973 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f60c80070b0 con 0x7f60d809e910 2024-09-18T13:16:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.701+0000 7f60bffff640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f60c403e930 0x7f60c4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.701+0000 7f60bffff640 1 -- 172.21.15.120:0/3116902973 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f60c804f960 con 0x7f60d809e910 2024-09-18T13:16:34.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.701+0000 7f60d6ffd640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f60c403e930 0x7f60c4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:34.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.702+0000 7f60d6ffd640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f60c403e930 0x7f60c4040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:34.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.706+0000 7f60bffff640 1 -- 172.21.15.120:0/3116902973 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f60c800dc60 con 0x7f60d809e910 2024-09-18T13:16:34.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.880+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60d8070340 con 0x7f60c403e930 2024-09-18T13:16:34.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.883+0000 7f60bffff640 1 -- 172.21.15.120:0/3116902973 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109018 (crc 0 0 0) 0x7f60cc00e3a0 con 0x7f60c403e930 2024-09-18T13:16:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T13:16:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f60c403e930 msgr2=0x7f60c4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f60c403e930 0x7f60c4040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 msgr2=0x7f60d809a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d809a400 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 shutdown_connections 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f60c403e930 0x7f60c4040e40 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 --2- 172.21.15.120:0/3116902973 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60d809e910 0x7f60d809a400 unknown :-1 s=CLOSED pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 >> 172.21.15.120:0/3116902973 conn(0x7f60d80a32a0 msgr2=0x7f60d80729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 shutdown_connections 2024-09-18T13:16:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:34.885+0000 7f60ddf91640 1 -- 172.21.15.120:0/3116902973 wait complete. 2024-09-18T13:16:34.897 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1284,"stamp":"2024-09-18T13:16:34.836744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":242208,"kb_used_data":14112,"kb_used_omap":0,"kb_used_meta":228032,"kb_avail":377245152,"statfs":{"total":386547056640,"available":386299035648,"internally_reserved":0,"allocated":14450688,"data_stored":7082822,"data_compressed":354470,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":233504768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001913"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552988+0000","last_change":"2024-09-18T13:02:43.599349+0000","last_active":"2024-09-18T13:16:01.552988+0000","last_peered":"2024-09-18T13:16:01.552988+0000","last_clean":"2024-09-18T13:16:01.552988+0000","last_became_active":"2024-09-18T13:02:43.590588+0000","last_became_peered":"2024-09-18T13:02:43.590588+0000","last_unstale":"2024-09-18T13:16:01.552988+0000","last_undegraded":"2024-09-18T13:16:01.552988+0000","last_fullsized":"2024-09-18T13:16:01.552988+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543414+0000","last_change":"2024-09-18T13:02:43.498337+0000","last_active":"2024-09-18T13:16:01.543414+0000","last_peered":"2024-09-18T13:16:01.543414+0000","last_clean":"2024-09-18T13:16:01.543414+0000","last_became_active":"2024-09-18T13:02:43.486897+0000","last_became_peered":"2024-09-18T13:02:43.486897+0000","last_unstale":"2024-09-18T13:16:01.543414+0000","last_undegraded":"2024-09-18T13:16:01.543414+0000","last_fullsized":"2024-09-18T13:16:01.543414+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550088+0000","last_change":"2024-09-18T13:02:43.540031+0000","last_active":"2024-09-18T13:16:01.550088+0000","last_peered":"2024-09-18T13:16:01.550088+0000","last_clean":"2024-09-18T13:16:01.550088+0000","last_became_active":"2024-09-18T13:02:43.532857+0000","last_became_peered":"2024-09-18T13:02:43.532857+0000","last_unstale":"2024-09-18T13:16:01.550088+0000","last_undegraded":"2024-09-18T13:16:01.550088+0000","last_fullsized":"2024-09-18T13:16:01.550088+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.540903+0000","last_change":"2024-09-18T13:02:43.533350+0000","last_active":"2024-09-18T13:16:01.540903+0000","last_peered":"2024-09-18T13:16:01.540903+0000","last_clean":"2024-09-18T13:16:01.540903+0000","last_became_active":"2024-09-18T13:02:43.511170+0000","last_became_peered":"2024-09-18T13:02:43.511170+0000","last_unstale":"2024-09-18T13:16:01.540903+0000","last_undegraded":"2024-09-18T13:16:01.540903+0000","last_fullsized":"2024-09-18T13:16:01.540903+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553782+0000","last_change":"2024-09-18T13:02:43.540161+0000","last_active":"2024-09-18T13:16:01.553782+0000","last_peered":"2024-09-18T13:16:01.553782+0000","last_clean":"2024-09-18T13:16:01.553782+0000","last_became_active":"2024-09-18T13:02:43.530098+0000","last_became_peered":"2024-09-18T13:02:43.530098+0000","last_unstale":"2024-09-18T13:16:01.553782+0000","last_undegraded":"2024-09-18T13:16:01.553782+0000","last_fullsized":"2024-09-18T13:16:01.553782+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556066+0000","last_change":"2024-09-18T13:02:43.596587+0000","last_active":"2024-09-18T13:16:01.556066+0000","last_peered":"2024-09-18T13:16:01.556066+0000","last_clean":"2024-09-18T13:16:01.556066+0000","last_became_active":"2024-09-18T13:02:43.586094+0000","last_became_peered":"2024-09-18T13:02:43.586094+0000","last_unstale":"2024-09-18T13:16:01.556066+0000","last_undegraded":"2024-09-18T13:16:01.556066+0000","last_fullsized":"2024-09-18T13:16:01.556066+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550582+0000","last_change":"2024-09-18T13:02:43.489572+0000","last_active":"2024-09-18T13:16:01.550582+0000","last_peered":"2024-09-18T13:16:01.550582+0000","last_clean":"2024-09-18T13:16:01.550582+0000","last_became_active":"2024-09-18T13:02:43.485079+0000","last_became_peered":"2024-09-18T13:02:43.485079+0000","last_unstale":"2024-09-18T13:16:01.550582+0000","last_undegraded":"2024-09-18T13:16:01.550582+0000","last_fullsized":"2024-09-18T13:16:01.550582+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.546093+0000","last_change":"2024-09-18T13:02:43.460695+0000","last_active":"2024-09-18T13:16:01.546093+0000","last_peered":"2024-09-18T13:16:01.546093+0000","last_clean":"2024-09-18T13:16:01.546093+0000","last_became_active":"2024-09-18T13:02:43.449840+0000","last_became_peered":"2024-09-18T13:02:43.449840+0000","last_unstale":"2024-09-18T13:16:01.546093+0000","last_undegraded":"2024-09-18T13:16:01.546093+0000","last_fullsized":"2024-09-18T13:16:01.546093+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552165+0000","last_change":"2024-09-18T13:02:43.561872+0000","last_active":"2024-09-18T13:16:01.552165+0000","last_peered":"2024-09-18T13:16:01.552165+0000","last_clean":"2024-09-18T13:16:01.552165+0000","last_became_active":"2024-09-18T13:02:43.556273+0000","last_became_peered":"2024-09-18T13:02:43.556273+0000","last_unstale":"2024-09-18T13:16:01.552165+0000","last_undegraded":"2024-09-18T13:16:01.552165+0000","last_fullsized":"2024-09-18T13:16:01.552165+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.561062+0000","last_change":"2024-09-18T13:02:43.570131+0000","last_active":"2024-09-18T13:16:01.561062+0000","last_peered":"2024-09-18T13:16:01.561062+0000","last_clean":"2024-09-18T13:16:01.561062+0000","last_became_active":"2024-09-18T13:02:43.560225+0000","last_became_peered":"2024-09-18T13:02:43.560225+0000","last_unstale":"2024-09-18T13:16:01.561062+0000","last_undegraded":"2024-09-18T13:16:01.561062+0000","last_fullsized":"2024-09-18T13:16:01.561062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551843+0000","last_change":"2024-09-18T13:02:43.436362+0000","last_active":"2024-09-18T13:16:01.551843+0000","last_peered":"2024-09-18T13:16:01.551843+0000","last_clean":"2024-09-18T13:16:01.551843+0000","last_became_active":"2024-09-18T13:02:43.423644+0000","last_became_peered":"2024-09-18T13:02:43.423644+0000","last_unstale":"2024-09-18T13:16:01.551843+0000","last_undegraded":"2024-09-18T13:16:01.551843+0000","last_fullsized":"2024-09-18T13:16:01.551843+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547337+0000","last_change":"2024-09-18T13:02:43.535591+0000","last_active":"2024-09-18T13:16:01.547337+0000","last_peered":"2024-09-18T13:16:01.547337+0000","last_clean":"2024-09-18T13:16:01.547337+0000","last_became_active":"2024-09-18T13:02:43.524825+0000","last_became_peered":"2024-09-18T13:02:43.524825+0000","last_unstale":"2024-09-18T13:16:01.547337+0000","last_undegraded":"2024-09-18T13:16:01.547337+0000","last_fullsized":"2024-09-18T13:16:01.547337+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.560376+0000","last_change":"2024-09-18T13:02:43.582811+0000","last_active":"2024-09-18T13:16:01.560376+0000","last_peered":"2024-09-18T13:16:01.560376+0000","last_clean":"2024-09-18T13:16:01.560376+0000","last_became_active":"2024-09-18T13:02:43.571390+0000","last_became_peered":"2024-09-18T13:02:43.571390+0000","last_unstale":"2024-09-18T13:16:01.560376+0000","last_undegraded":"2024-09-18T13:16:01.560376+0000","last_fullsized":"2024-09-18T13:16:01.560376+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.545464+0000","last_change":"2024-09-18T13:02:43.526115+0000","last_active":"2024-09-18T13:16:01.545464+0000","last_peered":"2024-09-18T13:16:01.545464+0000","last_clean":"2024-09-18T13:16:01.545464+0000","last_became_active":"2024-09-18T13:02:43.504340+0000","last_became_peered":"2024-09-18T13:02:43.504340+0000","last_unstale":"2024-09-18T13:16:01.545464+0000","last_undegraded":"2024-09-18T13:16:01.545464+0000","last_fullsized":"2024-09-18T13:16:01.545464+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558435+0000","last_change":"2024-09-18T13:02:43.576863+0000","last_active":"2024-09-18T13:16:01.558435+0000","last_peered":"2024-09-18T13:16:01.558435+0000","last_clean":"2024-09-18T13:16:01.558435+0000","last_became_active":"2024-09-18T13:02:43.568592+0000","last_became_peered":"2024-09-18T13:02:43.568592+0000","last_unstale":"2024-09-18T13:16:01.558435+0000","last_undegraded":"2024-09-18T13:16:01.558435+0000","last_fullsized":"2024-09-18T13:16:01.558435+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.541033+0000","last_change":"2024-09-18T13:02:43.498554+0000","last_active":"2024-09-18T13:16:01.541033+0000","last_peered":"2024-09-18T13:16:01.541033+0000","last_clean":"2024-09-18T13:16:01.541033+0000","last_became_active":"2024-09-18T13:02:43.492774+0000","last_became_peered":"2024-09-18T13:02:43.492774+0000","last_unstale":"2024-09-18T13:16:01.541033+0000","last_undegraded":"2024-09-18T13:16:01.541033+0000","last_fullsized":"2024-09-18T13:16:01.541033+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549649+0000","last_change":"2024-09-18T13:02:43.534935+0000","last_active":"2024-09-18T13:16:01.549649+0000","last_peered":"2024-09-18T13:16:01.549649+0000","last_clean":"2024-09-18T13:16:01.549649+0000","last_became_active":"2024-09-18T13:02:43.523232+0000","last_became_peered":"2024-09-18T13:02:43.523232+0000","last_unstale":"2024-09-18T13:16:01.549649+0000","last_undegraded":"2024-09-18T13:16:01.549649+0000","last_fullsized":"2024-09-18T13:16:01.549649+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551968+0000","last_change":"2024-09-18T13:02:43.576965+0000","last_active":"2024-09-18T13:16:01.551968+0000","last_peered":"2024-09-18T13:16:01.551968+0000","last_clean":"2024-09-18T13:16:01.551968+0000","last_became_active":"2024-09-18T13:02:43.565270+0000","last_became_peered":"2024-09-18T13:02:43.565270+0000","last_unstale":"2024-09-18T13:16:01.551968+0000","last_undegraded":"2024-09-18T13:16:01.551968+0000","last_fullsized":"2024-09-18T13:16:01.551968+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.539268+0000","last_change":"2024-09-18T13:02:43.489078+0000","last_active":"2024-09-18T13:16:01.539268+0000","last_peered":"2024-09-18T13:16:01.539268+0000","last_clean":"2024-09-18T13:16:01.539268+0000","last_became_active":"2024-09-18T13:02:43.475127+0000","last_became_peered":"2024-09-18T13:02:43.475127+0000","last_unstale":"2024-09-18T13:16:01.539268+0000","last_undegraded":"2024-09-18T13:16:01.539268+0000","last_fullsized":"2024-09-18T13:16:01.539268+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550254+0000","last_change":"2024-09-18T13:02:43.518460+0000","last_active":"2024-09-18T13:16:01.550254+0000","last_peered":"2024-09-18T13:16:01.550254+0000","last_clean":"2024-09-18T13:16:01.550254+0000","last_became_active":"2024-09-18T13:02:43.511706+0000","last_became_peered":"2024-09-18T13:02:43.511706+0000","last_unstale":"2024-09-18T13:16:01.550254+0000","last_undegraded":"2024-09-18T13:16:01.550254+0000","last_fullsized":"2024-09-18T13:16:01.550254+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557095+0000","last_change":"2024-09-18T13:02:43.547134+0000","last_active":"2024-09-18T13:16:01.557095+0000","last_peered":"2024-09-18T13:16:01.557095+0000","last_clean":"2024-09-18T13:16:01.557095+0000","last_became_active":"2024-09-18T13:02:43.540420+0000","last_became_peered":"2024-09-18T13:02:43.540420+0000","last_unstale":"2024-09-18T13:16:01.557095+0000","last_undegraded":"2024-09-18T13:16:01.557095+0000","last_fullsized":"2024-09-18T13:16:01.557095+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.548178+0000","last_change":"2024-09-18T13:02:43.513580+0000","last_active":"2024-09-18T13:16:01.548178+0000","last_peered":"2024-09-18T13:16:01.548178+0000","last_clean":"2024-09-18T13:16:01.548178+0000","last_became_active":"2024-09-18T13:02:43.506008+0000","last_became_peered":"2024-09-18T13:02:43.506008+0000","last_unstale":"2024-09-18T13:16:01.548178+0000","last_undegraded":"2024-09-18T13:16:01.548178+0000","last_fullsized":"2024-09-18T13:16:01.548178+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558001+0000","last_change":"2024-09-18T13:02:43.551512+0000","last_active":"2024-09-18T13:16:01.558001+0000","last_peered":"2024-09-18T13:16:01.558001+0000","last_clean":"2024-09-18T13:16:01.558001+0000","last_became_active":"2024-09-18T13:02:43.544809+0000","last_became_peered":"2024-09-18T13:02:43.544809+0000","last_unstale":"2024-09-18T13:16:01.558001+0000","last_undegraded":"2024-09-18T13:16:01.558001+0000","last_fullsized":"2024-09-18T13:16:01.558001+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553523+0000","last_change":"2024-09-18T13:02:43.552029+0000","last_active":"2024-09-18T13:16:01.553523+0000","last_peered":"2024-09-18T13:16:01.553523+0000","last_clean":"2024-09-18T13:16:01.553523+0000","last_became_active":"2024-09-18T13:02:43.532465+0000","last_became_peered":"2024-09-18T13:02:43.532465+0000","last_unstale":"2024-09-18T13:16:01.553523+0000","last_undegraded":"2024-09-18T13:16:01.553523+0000","last_fullsized":"2024-09-18T13:16:01.553523+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557180+0000","last_change":"2024-09-18T13:02:43.548538+0000","last_active":"2024-09-18T13:16:01.557180+0000","last_peered":"2024-09-18T13:16:01.557180+0000","last_clean":"2024-09-18T13:16:01.557180+0000","last_became_active":"2024-09-18T13:02:43.540114+0000","last_became_peered":"2024-09-18T13:02:43.540114+0000","last_unstale":"2024-09-18T13:16:01.557180+0000","last_undegraded":"2024-09-18T13:16:01.557180+0000","last_fullsized":"2024-09-18T13:16:01.557180+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556568+0000","last_change":"2024-09-18T13:02:43.528988+0000","last_active":"2024-09-18T13:16:01.556568+0000","last_peered":"2024-09-18T13:16:01.556568+0000","last_clean":"2024-09-18T13:16:01.556568+0000","last_became_active":"2024-09-18T13:02:43.519357+0000","last_became_peered":"2024-09-18T13:02:43.519357+0000","last_unstale":"2024-09-18T13:16:01.556568+0000","last_undegraded":"2024-09-18T13:16:01.556568+0000","last_fullsized":"2024-09-18T13:16:01.556568+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547849+0000","last_change":"2024-09-18T13:02:43.540324+0000","last_active":"2024-09-18T13:16:01.547849+0000","last_peered":"2024-09-18T13:16:01.547849+0000","last_clean":"2024-09-18T13:16:01.547849+0000","last_became_active":"2024-09-18T13:02:43.517545+0000","last_became_peered":"2024-09-18T13:02:43.517545+0000","last_unstale":"2024-09-18T13:16:01.547849+0000","last_undegraded":"2024-09-18T13:16:01.547849+0000","last_fullsized":"2024-09-18T13:16:01.547849+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549190+0000","last_change":"2024-09-18T13:02:43.479354+0000","last_active":"2024-09-18T13:16:01.549190+0000","last_peered":"2024-09-18T13:16:01.549190+0000","last_clean":"2024-09-18T13:16:01.549190+0000","last_became_active":"2024-09-18T13:02:43.467457+0000","last_became_peered":"2024-09-18T13:02:43.467457+0000","last_unstale":"2024-09-18T13:16:01.549190+0000","last_undegraded":"2024-09-18T13:16:01.549190+0000","last_fullsized":"2024-09-18T13:16:01.549190+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549054+0000","last_change":"2024-09-18T13:02:43.593763+0000","last_active":"2024-09-18T13:16:01.549054+0000","last_peered":"2024-09-18T13:16:01.549054+0000","last_clean":"2024-09-18T13:16:01.549054+0000","last_became_active":"2024-09-18T13:02:43.582192+0000","last_became_peered":"2024-09-18T13:02:43.582192+0000","last_unstale":"2024-09-18T13:16:01.549054+0000","last_undegraded":"2024-09-18T13:16:01.549054+0000","last_fullsized":"2024-09-18T13:16:01.549054+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551277+0000","last_change":"2024-09-18T13:02:43.562670+0000","last_active":"2024-09-18T13:16:01.551277+0000","last_peered":"2024-09-18T13:16:01.551277+0000","last_clean":"2024-09-18T13:16:01.551277+0000","last_became_active":"2024-09-18T13:02:43.550918+0000","last_became_peered":"2024-09-18T13:02:43.550918+0000","last_unstale":"2024-09-18T13:16:01.551277+0000","last_undegraded":"2024-09-18T13:16:01.551277+0000","last_fullsized":"2024-09-18T13:16:01.551277+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1467,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555073+0000","last_change":"2024-09-18T13:02:43.574240+0000","last_active":"2024-09-18T13:16:01.555073+0000","last_peered":"2024-09-18T13:16:01.555073+0000","last_clean":"2024-09-18T13:16:01.555073+0000","last_became_active":"2024-09-18T13:02:43.562324+0000","last_became_peered":"2024-09-18T13:02:43.562324+0000","last_unstale":"2024-09-18T13:16:01.555073+0000","last_undegraded":"2024-09-18T13:16:01.555073+0000","last_fullsized":"2024-09-18T13:16:01.555073+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.562621+0000","last_change":"2024-09-18T13:02:43.573284+0000","last_active":"2024-09-18T13:16:01.562621+0000","last_peered":"2024-09-18T13:16:01.562621+0000","last_clean":"2024-09-18T13:16:01.562621+0000","last_became_active":"2024-09-18T13:02:43.564846+0000","last_became_peered":"2024-09-18T13:02:43.564846+0000","last_unstale":"2024-09-18T13:16:01.562621+0000","last_undegraded":"2024-09-18T13:16:01.562621+0000","last_fullsized":"2024-09-18T13:16:01.562621+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544929+0000","last_change":"2024-09-18T12:57:44.682637+0000","last_active":"2024-09-18T13:16:01.544929+0000","last_peered":"2024-09-18T13:16:01.544929+0000","last_clean":"2024-09-18T13:16:01.544929+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T13:16:01.544929+0000","last_undegraded":"2024-09-18T13:16:01.544929+0000","last_fullsized":"2024-09-18T13:16:01.544929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555327+0000","last_change":"2024-09-18T12:57:44.684106+0000","last_active":"2024-09-18T13:16:01.555327+0000","last_peered":"2024-09-18T13:16:01.555327+0000","last_clean":"2024-09-18T13:16:01.555327+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T13:16:01.555327+0000","last_undegraded":"2024-09-18T13:16:01.555327+0000","last_fullsized":"2024-09-18T13:16:01.555327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.538460+0000","last_change":"2024-09-18T12:57:44.680252+0000","last_active":"2024-09-18T13:16:01.538460+0000","last_peered":"2024-09-18T13:16:01.538460+0000","last_clean":"2024-09-18T13:16:01.538460+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T13:16:01.538460+0000","last_undegraded":"2024-09-18T13:16:01.538460+0000","last_fullsized":"2024-09-18T13:16:01.538460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552778+0000","last_change":"2024-09-18T12:57:44.684632+0000","last_active":"2024-09-18T13:16:01.552778+0000","last_peered":"2024-09-18T13:16:01.552778+0000","last_clean":"2024-09-18T13:16:01.552778+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T13:16:01.552778+0000","last_undegraded":"2024-09-18T13:16:01.552778+0000","last_fullsized":"2024-09-18T13:16:01.552778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":2132,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550279+0000","last_change":"2024-09-18T12:57:44.684900+0000","last_active":"2024-09-18T13:16:01.550279+0000","last_peered":"2024-09-18T13:16:01.550279+0000","last_clean":"2024-09-18T13:16:01.550279+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T13:16:01.550279+0000","last_undegraded":"2024-09-18T13:16:01.550279+0000","last_fullsized":"2024-09-18T13:16:01.550279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552368+0000","last_change":"2024-09-18T12:57:44.684570+0000","last_active":"2024-09-18T13:16:01.552368+0000","last_peered":"2024-09-18T13:16:01.552368+0000","last_clean":"2024-09-18T13:16:01.552368+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T13:16:01.552368+0000","last_undegraded":"2024-09-18T13:16:01.552368+0000","last_fullsized":"2024-09-18T13:16:01.552368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543981+0000","last_change":"2024-09-18T12:57:44.682925+0000","last_active":"2024-09-18T13:16:01.543981+0000","last_peered":"2024-09-18T13:16:01.543981+0000","last_clean":"2024-09-18T13:16:01.543981+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T13:16:01.543981+0000","last_undegraded":"2024-09-18T13:16:01.543981+0000","last_fullsized":"2024-09-18T13:16:01.543981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":2131,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555285+0000","last_change":"2024-09-18T12:57:44.685288+0000","last_active":"2024-09-18T13:16:01.555285+0000","last_peered":"2024-09-18T13:16:01.555285+0000","last_clean":"2024-09-18T13:16:01.555285+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T13:16:01.555285+0000","last_undegraded":"2024-09-18T13:16:01.555285+0000","last_fullsized":"2024-09-18T13:16:01.555285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2205,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544207+0000","last_change":"2024-09-18T12:57:39.686575+0000","last_active":"2024-09-18T13:16:01.544207+0000","last_peered":"2024-09-18T13:16:01.544207+0000","last_clean":"2024-09-18T13:16:01.544207+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T13:16:01.544207+0000","last_undegraded":"2024-09-18T13:16:01.544207+0000","last_fullsized":"2024-09-18T13:16:01.544207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48364,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94323476,"statfs":{"total":96636764160,"available":96587239424,"internally_reserved":0,"allocated":3567616,"data_stored":1456221,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66512,"kb_used_data":3584,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305328,"statfs":{"total":96636764160,"available":96568655872,"internally_reserved":0,"allocated":3670016,"data_stored":2098065,"data_compressed":118355,"data_compressed_allocated":163840,"data_compressed_original":757760,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66480,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305360,"statfs":{"total":96636764160,"available":96568688640,"internally_reserved":0,"allocated":3637248,"data_stored":2059459,"data_compressed":100691,"data_compressed_allocated":139264,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60852,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310988,"statfs":{"total":96636764160,"available":96574451712,"internally_reserved":0,"allocated":3575808,"data_stored":1469077,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:16:34.899 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T13:16:34.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:16:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.002+0000 7fa3f9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:35.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.007+0000 7fa3f9311640 1 Processor -- start 2024-09-18T13:16:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.007+0000 7fa3f9311640 1 -- start start 2024-09-18T13:16:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f9311640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa3f409ca50 0x7fa3f409ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f9311640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f40a0060 con 0x7fa3f409d3a0 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f9311640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa3f409fd30 con 0x7fa3f409ca50 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f2ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa3f409ca50 0x7fa3f409ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f27fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa3f409d3a0 0x7fa3f4135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47702/0 (socket says 172.21.15.120:47702) 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f2ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa3f409ca50 0x7fa3f409ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60206/0 (socket says 172.21.15.120:60206) 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f27fc640 1 -- 172.21.15.120:0/3316247152 learned_addr learned my addr 172.21.15.120:0/3316247152 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f2ffd640 1 -- 172.21.15.120:0/3316247152 >> v1:172.21.15.120:6789/0 conn(0x7fa3f409d3a0 legacy=0x7fa3f4135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.008+0000 7fa3f1ffb640 1 -- 172.21.15.120:0/3316247152 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540178188 0 0) 0x7fa3f40a0060 con 0x7fa3f409d3a0 2024-09-18T13:16:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.009+0000 7fa3f2ffd640 1 -- 172.21.15.120:0/3316247152 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f409e3c0 con 0x7fa3f409ca50 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.009+0000 7fa3f2ffd640 1 --2- 172.21.15.120:0/3316247152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f409ce60 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d57c49664f836c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.009+0000 7fa3f1ffb640 1 -- 172.21.15.120:0/3316247152 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3ec009d80 con 0x7fa3f409ca50 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.009+0000 7fa3f1ffb640 1 -- 172.21.15.120:0/3316247152 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa3ec00e230 con 0x7fa3f409ca50 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.009+0000 7fa3f1ffb640 1 -- 172.21.15.120:0/3316247152 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3ec00e4d0 con 0x7fa3f409ca50 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.009+0000 7fa3f9311640 1 -- 172.21.15.120:0/3316247152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 msgr2=0x7fa3f409ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.009+0000 7fa3f9311640 1 --2- 172.21.15.120:0/3316247152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f409ce60 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.010+0000 7fa3f9311640 1 -- 172.21.15.120:0/3316247152 shutdown_connections 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.010+0000 7fa3f9311640 1 --2- 172.21.15.120:0/3316247152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f409ce60 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.010+0000 7fa3f9311640 1 -- 172.21.15.120:0/3316247152 >> 172.21.15.120:0/3316247152 conn(0x7fa3f40a5230 msgr2=0x7fa3f40a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.010+0000 7fa3f9311640 1 -- 172.21.15.120:0/3316247152 shutdown_connections 2024-09-18T13:16:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.010+0000 7fa3f9311640 1 -- 172.21.15.120:0/3316247152 wait complete. 2024-09-18T13:16:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.010+0000 7fa3f9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:35.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.011+0000 7fa3f9311640 1 Processor -- start 2024-09-18T13:16:35.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.011+0000 7fa3f9311640 1 -- start start 2024-09-18T13:16:35.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.012+0000 7fa3f9311640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f4124c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:35.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.012+0000 7fa3f9311640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4136230 con 0x7fa3f409ca50 2024-09-18T13:16:35.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.012+0000 7fa3f2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f4124c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:35.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.012+0000 7fa3f2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f4124c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60208/0 (socket says 172.21.15.120:60208) 2024-09-18T13:16:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.012+0000 7fa3f2ffd640 1 -- 172.21.15.120:0/2645032845 learned_addr learned my addr 172.21.15.120:0/2645032845 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.013+0000 7fa3f2ffd640 1 -- 172.21.15.120:0/2645032845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f4123520 con 0x7fa3f409ca50 2024-09-18T13:16:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.013+0000 7fa3f2ffd640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f4124c60 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.013+0000 7fa3db7fe640 1 -- 172.21.15.120:0/2645032845 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3ec013610 con 0x7fa3f409ca50 2024-09-18T13:16:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.013+0000 7fa3db7fe640 1 -- 172.21.15.120:0/2645032845 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa3ec013770 con 0x7fa3f409ca50 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.013+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f4122ed0 con 0x7fa3f409ca50 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.013+0000 7fa3db7fe640 1 -- 172.21.15.120:0/2645032845 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3ec013a10 con 0x7fa3f409ca50 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.013+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f4122bc0 con 0x7fa3f409ca50 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.014+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f409ce60 con 0x7fa3f409ca50 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.014+0000 7fa3db7fe640 1 -- 172.21.15.120:0/2645032845 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa3ec013bc0 con 0x7fa3f409ca50 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.014+0000 7fa3db7fe640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa3e003e930 0x7fa3e0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.014+0000 7fa3db7fe640 1 -- 172.21.15.120:0/2645032845 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7fa3ec018040 con 0x7fa3f409ca50 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.015+0000 7fa3f27fc640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa3e003e930 0x7fa3e0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.015+0000 7fa3f27fc640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa3e003e930 0x7fa3e0040e40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.019+0000 7fa3db7fe640 1 -- 172.21.15.120:0/2645032845 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fa3ec011570 con 0x7fa3f409ca50 2024-09-18T13:16:35.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.191+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3f409f9b0 con 0x7fa3e003e930 2024-09-18T13:16:35.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.194+0000 7fa3db7fe640 1 -- 172.21.15.120:0/2645032845 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109018 (crc 0 0 0) 0x7fa3e8005930 con 0x7fa3e003e930 2024-09-18T13:16:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T13:16:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T13:16:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa3e003e930 msgr2=0x7fa3e0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa3e003e930 0x7fa3e0040e40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 msgr2=0x7fa3f4124c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f4124c60 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 shutdown_connections 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fa3e003e930 0x7fa3e0040e40 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 --2- 172.21.15.120:0/2645032845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3f409ca50 0x7fa3f4124c60 unknown :-1 s=CLOSED pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 >> 172.21.15.120:0/2645032845 conn(0x7fa3f40a5230 msgr2=0x7fa3f40a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 shutdown_connections 2024-09-18T13:16:35.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.196+0000 7fa3f9311640 1 -- 172.21.15.120:0/2645032845 wait complete. 2024-09-18T13:16:35.209 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1284,"stamp":"2024-09-18T13:16:34.836744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":242208,"kb_used_data":14112,"kb_used_omap":0,"kb_used_meta":228032,"kb_avail":377245152,"statfs":{"total":386547056640,"available":386299035648,"internally_reserved":0,"allocated":14450688,"data_stored":7082822,"data_compressed":354470,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":233504768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001913"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552988+0000","last_change":"2024-09-18T13:02:43.599349+0000","last_active":"2024-09-18T13:16:01.552988+0000","last_peered":"2024-09-18T13:16:01.552988+0000","last_clean":"2024-09-18T13:16:01.552988+0000","last_became_active":"2024-09-18T13:02:43.590588+0000","last_became_peered":"2024-09-18T13:02:43.590588+0000","last_unstale":"2024-09-18T13:16:01.552988+0000","last_undegraded":"2024-09-18T13:16:01.552988+0000","last_fullsized":"2024-09-18T13:16:01.552988+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543414+0000","last_change":"2024-09-18T13:02:43.498337+0000","last_active":"2024-09-18T13:16:01.543414+0000","last_peered":"2024-09-18T13:16:01.543414+0000","last_clean":"2024-09-18T13:16:01.543414+0000","last_became_active":"2024-09-18T13:02:43.486897+0000","last_became_peered":"2024-09-18T13:02:43.486897+0000","last_unstale":"2024-09-18T13:16:01.543414+0000","last_undegraded":"2024-09-18T13:16:01.543414+0000","last_fullsized":"2024-09-18T13:16:01.543414+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550088+0000","last_change":"2024-09-18T13:02:43.540031+0000","last_active":"2024-09-18T13:16:01.550088+0000","last_peered":"2024-09-18T13:16:01.550088+0000","last_clean":"2024-09-18T13:16:01.550088+0000","last_became_active":"2024-09-18T13:02:43.532857+0000","last_became_peered":"2024-09-18T13:02:43.532857+0000","last_unstale":"2024-09-18T13:16:01.550088+0000","last_undegraded":"2024-09-18T13:16:01.550088+0000","last_fullsized":"2024-09-18T13:16:01.550088+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.540903+0000","last_change":"2024-09-18T13:02:43.533350+0000","last_active":"2024-09-18T13:16:01.540903+0000","last_peered":"2024-09-18T13:16:01.540903+0000","last_clean":"2024-09-18T13:16:01.540903+0000","last_became_active":"2024-09-18T13:02:43.511170+0000","last_became_peered":"2024-09-18T13:02:43.511170+0000","last_unstale":"2024-09-18T13:16:01.540903+0000","last_undegraded":"2024-09-18T13:16:01.540903+0000","last_fullsized":"2024-09-18T13:16:01.540903+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553782+0000","last_change":"2024-09-18T13:02:43.540161+0000","last_active":"2024-09-18T13:16:01.553782+0000","last_peered":"2024-09-18T13:16:01.553782+0000","last_clean":"2024-09-18T13:16:01.553782+0000","last_became_active":"2024-09-18T13:02:43.530098+0000","last_became_peered":"2024-09-18T13:02:43.530098+0000","last_unstale":"2024-09-18T13:16:01.553782+0000","last_undegraded":"2024-09-18T13:16:01.553782+0000","last_fullsized":"2024-09-18T13:16:01.553782+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556066+0000","last_change":"2024-09-18T13:02:43.596587+0000","last_active":"2024-09-18T13:16:01.556066+0000","last_peered":"2024-09-18T13:16:01.556066+0000","last_clean":"2024-09-18T13:16:01.556066+0000","last_became_active":"2024-09-18T13:02:43.586094+0000","last_became_peered":"2024-09-18T13:02:43.586094+0000","last_unstale":"2024-09-18T13:16:01.556066+0000","last_undegraded":"2024-09-18T13:16:01.556066+0000","last_fullsized":"2024-09-18T13:16:01.556066+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550582+0000","last_change":"2024-09-18T13:02:43.489572+0000","last_active":"2024-09-18T13:16:01.550582+0000","last_peered":"2024-09-18T13:16:01.550582+0000","last_clean":"2024-09-18T13:16:01.550582+0000","last_became_active":"2024-09-18T13:02:43.485079+0000","last_became_peered":"2024-09-18T13:02:43.485079+0000","last_unstale":"2024-09-18T13:16:01.550582+0000","last_undegraded":"2024-09-18T13:16:01.550582+0000","last_fullsized":"2024-09-18T13:16:01.550582+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.546093+0000","last_change":"2024-09-18T13:02:43.460695+0000","last_active":"2024-09-18T13:16:01.546093+0000","last_peered":"2024-09-18T13:16:01.546093+0000","last_clean":"2024-09-18T13:16:01.546093+0000","last_became_active":"2024-09-18T13:02:43.449840+0000","last_became_peered":"2024-09-18T13:02:43.449840+0000","last_unstale":"2024-09-18T13:16:01.546093+0000","last_undegraded":"2024-09-18T13:16:01.546093+0000","last_fullsized":"2024-09-18T13:16:01.546093+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552165+0000","last_change":"2024-09-18T13:02:43.561872+0000","last_active":"2024-09-18T13:16:01.552165+0000","last_peered":"2024-09-18T13:16:01.552165+0000","last_clean":"2024-09-18T13:16:01.552165+0000","last_became_active":"2024-09-18T13:02:43.556273+0000","last_became_peered":"2024-09-18T13:02:43.556273+0000","last_unstale":"2024-09-18T13:16:01.552165+0000","last_undegraded":"2024-09-18T13:16:01.552165+0000","last_fullsized":"2024-09-18T13:16:01.552165+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.561062+0000","last_change":"2024-09-18T13:02:43.570131+0000","last_active":"2024-09-18T13:16:01.561062+0000","last_peered":"2024-09-18T13:16:01.561062+0000","last_clean":"2024-09-18T13:16:01.561062+0000","last_became_active":"2024-09-18T13:02:43.560225+0000","last_became_peered":"2024-09-18T13:02:43.560225+0000","last_unstale":"2024-09-18T13:16:01.561062+0000","last_undegraded":"2024-09-18T13:16:01.561062+0000","last_fullsized":"2024-09-18T13:16:01.561062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551843+0000","last_change":"2024-09-18T13:02:43.436362+0000","last_active":"2024-09-18T13:16:01.551843+0000","last_peered":"2024-09-18T13:16:01.551843+0000","last_clean":"2024-09-18T13:16:01.551843+0000","last_became_active":"2024-09-18T13:02:43.423644+0000","last_became_peered":"2024-09-18T13:02:43.423644+0000","last_unstale":"2024-09-18T13:16:01.551843+0000","last_undegraded":"2024-09-18T13:16:01.551843+0000","last_fullsized":"2024-09-18T13:16:01.551843+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547337+0000","last_change":"2024-09-18T13:02:43.535591+0000","last_active":"2024-09-18T13:16:01.547337+0000","last_peered":"2024-09-18T13:16:01.547337+0000","last_clean":"2024-09-18T13:16:01.547337+0000","last_became_active":"2024-09-18T13:02:43.524825+0000","last_became_peered":"2024-09-18T13:02:43.524825+0000","last_unstale":"2024-09-18T13:16:01.547337+0000","last_undegraded":"2024-09-18T13:16:01.547337+0000","last_fullsized":"2024-09-18T13:16:01.547337+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.560376+0000","last_change":"2024-09-18T13:02:43.582811+0000","last_active":"2024-09-18T13:16:01.560376+0000","last_peered":"2024-09-18T13:16:01.560376+0000","last_clean":"2024-09-18T13:16:01.560376+0000","last_became_active":"2024-09-18T13:02:43.571390+0000","last_became_peered":"2024-09-18T13:02:43.571390+0000","last_unstale":"2024-09-18T13:16:01.560376+0000","last_undegraded":"2024-09-18T13:16:01.560376+0000","last_fullsized":"2024-09-18T13:16:01.560376+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.545464+0000","last_change":"2024-09-18T13:02:43.526115+0000","last_active":"2024-09-18T13:16:01.545464+0000","last_peered":"2024-09-18T13:16:01.545464+0000","last_clean":"2024-09-18T13:16:01.545464+0000","last_became_active":"2024-09-18T13:02:43.504340+0000","last_became_peered":"2024-09-18T13:02:43.504340+0000","last_unstale":"2024-09-18T13:16:01.545464+0000","last_undegraded":"2024-09-18T13:16:01.545464+0000","last_fullsized":"2024-09-18T13:16:01.545464+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558435+0000","last_change":"2024-09-18T13:02:43.576863+0000","last_active":"2024-09-18T13:16:01.558435+0000","last_peered":"2024-09-18T13:16:01.558435+0000","last_clean":"2024-09-18T13:16:01.558435+0000","last_became_active":"2024-09-18T13:02:43.568592+0000","last_became_peered":"2024-09-18T13:02:43.568592+0000","last_unstale":"2024-09-18T13:16:01.558435+0000","last_undegraded":"2024-09-18T13:16:01.558435+0000","last_fullsized":"2024-09-18T13:16:01.558435+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.541033+0000","last_change":"2024-09-18T13:02:43.498554+0000","last_active":"2024-09-18T13:16:01.541033+0000","last_peered":"2024-09-18T13:16:01.541033+0000","last_clean":"2024-09-18T13:16:01.541033+0000","last_became_active":"2024-09-18T13:02:43.492774+0000","last_became_peered":"2024-09-18T13:02:43.492774+0000","last_unstale":"2024-09-18T13:16:01.541033+0000","last_undegraded":"2024-09-18T13:16:01.541033+0000","last_fullsized":"2024-09-18T13:16:01.541033+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549649+0000","last_change":"2024-09-18T13:02:43.534935+0000","last_active":"2024-09-18T13:16:01.549649+0000","last_peered":"2024-09-18T13:16:01.549649+0000","last_clean":"2024-09-18T13:16:01.549649+0000","last_became_active":"2024-09-18T13:02:43.523232+0000","last_became_peered":"2024-09-18T13:02:43.523232+0000","last_unstale":"2024-09-18T13:16:01.549649+0000","last_undegraded":"2024-09-18T13:16:01.549649+0000","last_fullsized":"2024-09-18T13:16:01.549649+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551968+0000","last_change":"2024-09-18T13:02:43.576965+0000","last_active":"2024-09-18T13:16:01.551968+0000","last_peered":"2024-09-18T13:16:01.551968+0000","last_clean":"2024-09-18T13:16:01.551968+0000","last_became_active":"2024-09-18T13:02:43.565270+0000","last_became_peered":"2024-09-18T13:02:43.565270+0000","last_unstale":"2024-09-18T13:16:01.551968+0000","last_undegraded":"2024-09-18T13:16:01.551968+0000","last_fullsized":"2024-09-18T13:16:01.551968+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.539268+0000","last_change":"2024-09-18T13:02:43.489078+0000","last_active":"2024-09-18T13:16:01.539268+0000","last_peered":"2024-09-18T13:16:01.539268+0000","last_clean":"2024-09-18T13:16:01.539268+0000","last_became_active":"2024-09-18T13:02:43.475127+0000","last_became_peered":"2024-09-18T13:02:43.475127+0000","last_unstale":"2024-09-18T13:16:01.539268+0000","last_undegraded":"2024-09-18T13:16:01.539268+0000","last_fullsized":"2024-09-18T13:16:01.539268+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550254+0000","last_change":"2024-09-18T13:02:43.518460+0000","last_active":"2024-09-18T13:16:01.550254+0000","last_peered":"2024-09-18T13:16:01.550254+0000","last_clean":"2024-09-18T13:16:01.550254+0000","last_became_active":"2024-09-18T13:02:43.511706+0000","last_became_peered":"2024-09-18T13:02:43.511706+0000","last_unstale":"2024-09-18T13:16:01.550254+0000","last_undegraded":"2024-09-18T13:16:01.550254+0000","last_fullsized":"2024-09-18T13:16:01.550254+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557095+0000","last_change":"2024-09-18T13:02:43.547134+0000","last_active":"2024-09-18T13:16:01.557095+0000","last_peered":"2024-09-18T13:16:01.557095+0000","last_clean":"2024-09-18T13:16:01.557095+0000","last_became_active":"2024-09-18T13:02:43.540420+0000","last_became_peered":"2024-09-18T13:02:43.540420+0000","last_unstale":"2024-09-18T13:16:01.557095+0000","last_undegraded":"2024-09-18T13:16:01.557095+0000","last_fullsized":"2024-09-18T13:16:01.557095+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.548178+0000","last_change":"2024-09-18T13:02:43.513580+0000","last_active":"2024-09-18T13:16:01.548178+0000","last_peered":"2024-09-18T13:16:01.548178+0000","last_clean":"2024-09-18T13:16:01.548178+0000","last_became_active":"2024-09-18T13:02:43.506008+0000","last_became_peered":"2024-09-18T13:02:43.506008+0000","last_unstale":"2024-09-18T13:16:01.548178+0000","last_undegraded":"2024-09-18T13:16:01.548178+0000","last_fullsized":"2024-09-18T13:16:01.548178+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558001+0000","last_change":"2024-09-18T13:02:43.551512+0000","last_active":"2024-09-18T13:16:01.558001+0000","last_peered":"2024-09-18T13:16:01.558001+0000","last_clean":"2024-09-18T13:16:01.558001+0000","last_became_active":"2024-09-18T13:02:43.544809+0000","last_became_peered":"2024-09-18T13:02:43.544809+0000","last_unstale":"2024-09-18T13:16:01.558001+0000","last_undegraded":"2024-09-18T13:16:01.558001+0000","last_fullsized":"2024-09-18T13:16:01.558001+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553523+0000","last_change":"2024-09-18T13:02:43.552029+0000","last_active":"2024-09-18T13:16:01.553523+0000","last_peered":"2024-09-18T13:16:01.553523+0000","last_clean":"2024-09-18T13:16:01.553523+0000","last_became_active":"2024-09-18T13:02:43.532465+0000","last_became_peered":"2024-09-18T13:02:43.532465+0000","last_unstale":"2024-09-18T13:16:01.553523+0000","last_undegraded":"2024-09-18T13:16:01.553523+0000","last_fullsized":"2024-09-18T13:16:01.553523+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557180+0000","last_change":"2024-09-18T13:02:43.548538+0000","last_active":"2024-09-18T13:16:01.557180+0000","last_peered":"2024-09-18T13:16:01.557180+0000","last_clean":"2024-09-18T13:16:01.557180+0000","last_became_active":"2024-09-18T13:02:43.540114+0000","last_became_peered":"2024-09-18T13:02:43.540114+0000","last_unstale":"2024-09-18T13:16:01.557180+0000","last_undegraded":"2024-09-18T13:16:01.557180+0000","last_fullsized":"2024-09-18T13:16:01.557180+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556568+0000","last_change":"2024-09-18T13:02:43.528988+0000","last_active":"2024-09-18T13:16:01.556568+0000","last_peered":"2024-09-18T13:16:01.556568+0000","last_clean":"2024-09-18T13:16:01.556568+0000","last_became_active":"2024-09-18T13:02:43.519357+0000","last_became_peered":"2024-09-18T13:02:43.519357+0000","last_unstale":"2024-09-18T13:16:01.556568+0000","last_undegraded":"2024-09-18T13:16:01.556568+0000","last_fullsized":"2024-09-18T13:16:01.556568+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547849+0000","last_change":"2024-09-18T13:02:43.540324+0000","last_active":"2024-09-18T13:16:01.547849+0000","last_peered":"2024-09-18T13:16:01.547849+0000","last_clean":"2024-09-18T13:16:01.547849+0000","last_became_active":"2024-09-18T13:02:43.517545+0000","last_became_peered":"2024-09-18T13:02:43.517545+0000","last_unstale":"2024-09-18T13:16:01.547849+0000","last_undegraded":"2024-09-18T13:16:01.547849+0000","last_fullsized":"2024-09-18T13:16:01.547849+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549190+0000","last_change":"2024-09-18T13:02:43.479354+0000","last_active":"2024-09-18T13:16:01.549190+0000","last_peered":"2024-09-18T13:16:01.549190+0000","last_clean":"2024-09-18T13:16:01.549190+0000","last_became_active":"2024-09-18T13:02:43.467457+0000","last_became_peered":"2024-09-18T13:02:43.467457+0000","last_unstale":"2024-09-18T13:16:01.549190+0000","last_undegraded":"2024-09-18T13:16:01.549190+0000","last_fullsized":"2024-09-18T13:16:01.549190+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549054+0000","last_change":"2024-09-18T13:02:43.593763+0000","last_active":"2024-09-18T13:16:01.549054+0000","last_peered":"2024-09-18T13:16:01.549054+0000","last_clean":"2024-09-18T13:16:01.549054+0000","last_became_active":"2024-09-18T13:02:43.582192+0000","last_became_peered":"2024-09-18T13:02:43.582192+0000","last_unstale":"2024-09-18T13:16:01.549054+0000","last_undegraded":"2024-09-18T13:16:01.549054+0000","last_fullsized":"2024-09-18T13:16:01.549054+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551277+0000","last_change":"2024-09-18T13:02:43.562670+0000","last_active":"2024-09-18T13:16:01.551277+0000","last_peered":"2024-09-18T13:16:01.551277+0000","last_clean":"2024-09-18T13:16:01.551277+0000","last_became_active":"2024-09-18T13:02:43.550918+0000","last_became_peered":"2024-09-18T13:02:43.550918+0000","last_unstale":"2024-09-18T13:16:01.551277+0000","last_undegraded":"2024-09-18T13:16:01.551277+0000","last_fullsized":"2024-09-18T13:16:01.551277+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1467,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555073+0000","last_change":"2024-09-18T13:02:43.574240+0000","last_active":"2024-09-18T13:16:01.555073+0000","last_peered":"2024-09-18T13:16:01.555073+0000","last_clean":"2024-09-18T13:16:01.555073+0000","last_became_active":"2024-09-18T13:02:43.562324+0000","last_became_peered":"2024-09-18T13:02:43.562324+0000","last_unstale":"2024-09-18T13:16:01.555073+0000","last_undegraded":"2024-09-18T13:16:01.555073+0000","last_fullsized":"2024-09-18T13:16:01.555073+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.562621+0000","last_change":"2024-09-18T13:02:43.573284+0000","last_active":"2024-09-18T13:16:01.562621+0000","last_peered":"2024-09-18T13:16:01.562621+0000","last_clean":"2024-09-18T13:16:01.562621+0000","last_became_active":"2024-09-18T13:02:43.564846+0000","last_became_peered":"2024-09-18T13:02:43.564846+0000","last_unstale":"2024-09-18T13:16:01.562621+0000","last_undegraded":"2024-09-18T13:16:01.562621+0000","last_fullsized":"2024-09-18T13:16:01.562621+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544929+0000","last_change":"2024-09-18T12:57:44.682637+0000","last_active":"2024-09-18T13:16:01.544929+0000","last_peered":"2024-09-18T13:16:01.544929+0000","last_clean":"2024-09-18T13:16:01.544929+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T13:16:01.544929+0000","last_undegraded":"2024-09-18T13:16:01.544929+0000","last_fullsized":"2024-09-18T13:16:01.544929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555327+0000","last_change":"2024-09-18T12:57:44.684106+0000","last_active":"2024-09-18T13:16:01.555327+0000","last_peered":"2024-09-18T13:16:01.555327+0000","last_clean":"2024-09-18T13:16:01.555327+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T13:16:01.555327+0000","last_undegraded":"2024-09-18T13:16:01.555327+0000","last_fullsized":"2024-09-18T13:16:01.555327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.538460+0000","last_change":"2024-09-18T12:57:44.680252+0000","last_active":"2024-09-18T13:16:01.538460+0000","last_peered":"2024-09-18T13:16:01.538460+0000","last_clean":"2024-09-18T13:16:01.538460+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T13:16:01.538460+0000","last_undegraded":"2024-09-18T13:16:01.538460+0000","last_fullsized":"2024-09-18T13:16:01.538460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552778+0000","last_change":"2024-09-18T12:57:44.684632+0000","last_active":"2024-09-18T13:16:01.552778+0000","last_peered":"2024-09-18T13:16:01.552778+0000","last_clean":"2024-09-18T13:16:01.552778+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T13:16:01.552778+0000","last_undegraded":"2024-09-18T13:16:01.552778+0000","last_fullsized":"2024-09-18T13:16:01.552778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":2132,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550279+0000","last_change":"2024-09-18T12:57:44.684900+0000","last_active":"2024-09-18T13:16:01.550279+0000","last_peered":"2024-09-18T13:16:01.550279+0000","last_clean":"2024-09-18T13:16:01.550279+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T13:16:01.550279+0000","last_undegraded":"2024-09-18T13:16:01.550279+0000","last_fullsized":"2024-09-18T13:16:01.550279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552368+0000","last_change":"2024-09-18T12:57:44.684570+0000","last_active":"2024-09-18T13:16:01.552368+0000","last_peered":"2024-09-18T13:16:01.552368+0000","last_clean":"2024-09-18T13:16:01.552368+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T13:16:01.552368+0000","last_undegraded":"2024-09-18T13:16:01.552368+0000","last_fullsized":"2024-09-18T13:16:01.552368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543981+0000","last_change":"2024-09-18T12:57:44.682925+0000","last_active":"2024-09-18T13:16:01.543981+0000","last_peered":"2024-09-18T13:16:01.543981+0000","last_clean":"2024-09-18T13:16:01.543981+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T13:16:01.543981+0000","last_undegraded":"2024-09-18T13:16:01.543981+0000","last_fullsized":"2024-09-18T13:16:01.543981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":2131,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555285+0000","last_change":"2024-09-18T12:57:44.685288+0000","last_active":"2024-09-18T13:16:01.555285+0000","last_peered":"2024-09-18T13:16:01.555285+0000","last_clean":"2024-09-18T13:16:01.555285+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T13:16:01.555285+0000","last_undegraded":"2024-09-18T13:16:01.555285+0000","last_fullsized":"2024-09-18T13:16:01.555285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2205,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544207+0000","last_change":"2024-09-18T12:57:39.686575+0000","last_active":"2024-09-18T13:16:01.544207+0000","last_peered":"2024-09-18T13:16:01.544207+0000","last_clean":"2024-09-18T13:16:01.544207+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T13:16:01.544207+0000","last_undegraded":"2024-09-18T13:16:01.544207+0000","last_fullsized":"2024-09-18T13:16:01.544207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48364,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94323476,"statfs":{"total":96636764160,"available":96587239424,"internally_reserved":0,"allocated":3567616,"data_stored":1456221,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66512,"kb_used_data":3584,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305328,"statfs":{"total":96636764160,"available":96568655872,"internally_reserved":0,"allocated":3670016,"data_stored":2098065,"data_compressed":118355,"data_compressed_allocated":163840,"data_compressed_original":757760,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66480,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305360,"statfs":{"total":96636764160,"available":96568688640,"internally_reserved":0,"allocated":3637248,"data_stored":2059459,"data_compressed":100691,"data_compressed_allocated":139264,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60852,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310988,"statfs":{"total":96636764160,"available":96574451712,"internally_reserved":0,"allocated":3575808,"data_stored":1469077,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:16:35.211 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T13:16:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.315+0000 7f998e0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.320+0000 7f998e0c8640 1 Processor -- start 2024-09-18T13:16:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.320+0000 7f998e0c8640 1 -- start start 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f998e0c8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9988138fd0 0x7f998813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f998e0c8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9988136c10 con 0x7f99881360f0 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f998e0c8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f99880a6010 con 0x7f9988138fd0 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f9986ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9988138fd0 0x7f998813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f99877fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f99881360f0 0x7f9988136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47704/0 (socket says 172.21.15.120:47704) 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f99877fe640 1 -- 172.21.15.120:0/4225993944 learned_addr learned my addr 172.21.15.120:0/4225993944 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f9986ffd640 1 -- 172.21.15.120:0/4225993944 >> v1:172.21.15.120:6789/0 conn(0x7f99881360f0 legacy=0x7f9988136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f99867fc640 1 -- 172.21.15.120:0/4225993944 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543943569 0 0) 0x7f9978001490 con 0x7f99881360f0 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f9986ffd640 1 -- 172.21.15.120:0/4225993944 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99880a5c40 con 0x7f9988138fd0 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.321+0000 7f9986ffd640 1 --2- 172.21.15.120:0/4225993944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9988138fd0 0x7f998813b3f0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59745aa6e6070ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f99867fc640 1 -- 172.21.15.120:0/4225993944 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f997c009d90 con 0x7f9988138fd0 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f99867fc640 1 -- 172.21.15.120:0/4225993944 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f997c00e230 con 0x7f9988138fd0 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f99867fc640 1 -- 172.21.15.120:0/4225993944 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f997c00e4d0 con 0x7f9988138fd0 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f998e0c8640 1 -- 172.21.15.120:0/4225993944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9988138fd0 msgr2=0x7f998813b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f998e0c8640 1 --2- 172.21.15.120:0/4225993944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9988138fd0 0x7f998813b3f0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f998e0c8640 1 -- 172.21.15.120:0/4225993944 shutdown_connections 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f998e0c8640 1 --2- 172.21.15.120:0/4225993944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9988138fd0 0x7f998813b3f0 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f998e0c8640 1 -- 172.21.15.120:0/4225993944 >> 172.21.15.120:0/4225993944 conn(0x7f998806f850 msgr2=0x7f998809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f998e0c8640 1 -- 172.21.15.120:0/4225993944 shutdown_connections 2024-09-18T13:16:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.322+0000 7f998e0c8640 1 -- 172.21.15.120:0/4225993944 wait complete. 2024-09-18T13:16:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.323+0000 7f998e0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.324+0000 7f998e0c8640 1 Processor -- start 2024-09-18T13:16:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.324+0000 7f998e0c8640 1 -- start start 2024-09-18T13:16:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.325+0000 7f998e0c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99881360f0 0x7f99881231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.325+0000 7f998e0c8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9988122e30 con 0x7f99881360f0 2024-09-18T13:16:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.325+0000 7f99877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99881360f0 0x7f99881231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.325+0000 7f99877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99881360f0 0x7f99881231f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60222/0 (socket says 172.21.15.120:60222) 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.325+0000 7f99877fe640 1 -- 172.21.15.120:0/1204081309 learned_addr learned my addr 172.21.15.120:0/1204081309 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.325+0000 7f99877fe640 1 -- 172.21.15.120:0/1204081309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9988124f70 con 0x7f99881360f0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.326+0000 7f99877fe640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99881360f0 0x7f99881231f0 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.326+0000 7f996ffff640 1 -- 172.21.15.120:0/1204081309 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9978004bc0 con 0x7f99881360f0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.326+0000 7f996ffff640 1 -- 172.21.15.120:0/1204081309 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9978004d20 con 0x7f99881360f0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.326+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9988125220 con 0x7f99881360f0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.326+0000 7f996ffff640 1 -- 172.21.15.120:0/1204081309 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9978007120 con 0x7f99881360f0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.326+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9988122780 con 0x7f99881360f0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.327+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99880a10f0 con 0x7f99881360f0 2024-09-18T13:16:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.327+0000 7f996ffff640 1 -- 172.21.15.120:0/1204081309 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f99780072d0 con 0x7f99881360f0 2024-09-18T13:16:35.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.327+0000 7f996ffff640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f997403e960 0x7f9974040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:35.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.327+0000 7f996ffff640 1 -- 172.21.15.120:0/1204081309 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f9978050140 con 0x7f99881360f0 2024-09-18T13:16:35.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.328+0000 7f9986ffd640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f997403e960 0x7f9974040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:35.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.328+0000 7f9986ffd640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f997403e960 0x7f9974040e70 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.332+0000 7f996ffff640 1 -- 172.21.15.120:0/1204081309 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f99780064d0 con 0x7f99881360f0 2024-09-18T13:16:35.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.509+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9988136c10 con 0x7f99881360f0 2024-09-18T13:16:35.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.509+0000 7f996ffff640 1 -- 172.21.15.120:0/1204081309 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v723) ==== 74+0+11279 (crc 0 0 0) 0x7f9988136c10 con 0x7f99881360f0 2024-09-18T13:16:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T13:16:35.511 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":723,"fsid":"663d1a24-c7eb-48da-8c03-7f80c4504c0c","created":"2024-09-18T12:57:30.264061+0000","modified":"2024-09-18T13:16:33.515670+0000","last_up_change":"2024-09-18T12:57:37.580418+0000","last_in_change":"2024-09-18T12:57:32.374074+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:57:38.593562+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T12:57:40.655372+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-18T13:02:41.442869+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"240","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e4a6d0f-6fc8-4b06-8894-d92d041e9c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6801","nonce":1764758402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1764758402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1764758402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6805","nonce":1764758402}]},"public_addr":"172.21.15.120:6801/1764758402","cluster_addr":"172.21.15.120:6802/1764758402","heartbeat_back_addr":"172.21.15.120:6800/1764758402","heartbeat_front_addr":"172.21.15.120:6805/1764758402","state":["exists","up"]},{"osd":1,"uuid":"7c214373-8f9a-4112-a594-9ae4ec75bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6803","nonce":3478481720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3478481720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3478481720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6807","nonce":3478481720}]},"public_addr":"172.21.15.120:6803/3478481720","cluster_addr":"172.21.15.120:6804/3478481720","heartbeat_back_addr":"172.21.15.120:6806/3478481720","heartbeat_front_addr":"172.21.15.120:6807/3478481720","state":["exists","up"]},{"osd":2,"uuid":"40171e53-c072-4abe-9d3c-68ca18165c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1480150686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6803","nonce":1480150686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":1480150686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":1480150686}]},"public_addr":"172.21.15.176:6802/1480150686","cluster_addr":"172.21.15.176:6803/1480150686","heartbeat_back_addr":"172.21.15.176:6809/1480150686","heartbeat_front_addr":"172.21.15.176:6808/1480150686","state":["exists","up"]},{"osd":3,"uuid":"d7aca28d-af63-4f64-8ca2-3b4c010c6e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2606993558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":2606993558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2606993558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6807","nonce":2606993558}]},"public_addr":"172.21.15.176:6806/2606993558","cluster_addr":"172.21.15.176:6805/2606993558","heartbeat_back_addr":"172.21.15.176:6804/2606993558","heartbeat_front_addr":"172.21.15.176:6807/2606993558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T13:16:35.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f997403e960 msgr2=0x7f9974040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f997403e960 0x7f9974040e70 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99881360f0 msgr2=0x7f99881231f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99881360f0 0x7f99881231f0 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 shutdown_connections 2024-09-18T13:16:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f997403e960 0x7f9974040e70 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 --2- 172.21.15.120:0/1204081309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99881360f0 0x7f99881231f0 unknown :-1 s=CLOSED pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 >> 172.21.15.120:0/1204081309 conn(0x7f998806f850 msgr2=0x7f998809df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 shutdown_connections 2024-09-18T13:16:35.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:35.512+0000 7f998e0c8640 1 -- 172.21.15.120:0/1204081309 wait complete. 2024-09-18T13:16:36.525 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T13:16:36.525 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T13:16:36.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.636+0000 7f48fe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:36.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.648+0000 7f48fe191640 1 Processor -- start 2024-09-18T13:16:36.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.648+0000 7f48fe191640 1 -- start start 2024-09-18T13:16:36.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48fe191640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48f809da60 0x7f48f809de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:36.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48fe191640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f809ee20 con 0x7f48f809e3b0 2024-09-18T13:16:36.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48fe191640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f48f809f560 con 0x7f48f809da60 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f77fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48f809da60 0x7f48f809de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f6ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f48f809e3b0 0x7f48f8135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47714/0 (socket says 172.21.15.120:47714) 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f6ffd640 1 -- 172.21.15.120:0/1675556460 learned_addr learned my addr 172.21.15.120:0/1675556460 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f77fe640 1 -- 172.21.15.120:0/1675556460 >> v1:172.21.15.120:6789/0 conn(0x7f48f809e3b0 legacy=0x7f48f8135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f77fe640 1 -- 172.21.15.120:0/1675556460 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f809eb10 con 0x7f48f809da60 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f67fc640 1 -- 172.21.15.120:0/1675556460 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626807524 0 0) 0x7f48f809ee20 con 0x7f48f809e3b0 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f77fe640 1 --2- 172.21.15.120:0/1675556460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f809de70 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996d3db3c0295af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f67fc640 1 -- 172.21.15.120:0/1675556460 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f48e800e040 con 0x7f48f809da60 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f67fc640 1 -- 172.21.15.120:0/1675556460 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f48e8007670 con 0x7f48f809da60 2024-09-18T13:16:36.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.649+0000 7f48f67fc640 1 -- 172.21.15.120:0/1675556460 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f48e8007910 con 0x7f48f809da60 2024-09-18T13:16:36.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 1 -- 172.21.15.120:0/1675556460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 msgr2=0x7f48f809de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 1 --2- 172.21.15.120:0/1675556460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f809de70 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 1 -- 172.21.15.120:0/1675556460 shutdown_connections 2024-09-18T13:16:36.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 1 --2- 172.21.15.120:0/1675556460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f809de70 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 1 -- 172.21.15.120:0/1675556460 >> 172.21.15.120:0/1675556460 conn(0x7f48f806eb10 msgr2=0x7f48f806ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:36.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 1 -- 172.21.15.120:0/1675556460 shutdown_connections 2024-09-18T13:16:36.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 1 -- 172.21.15.120:0/1675556460 wait complete. 2024-09-18T13:16:36.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.650+0000 7f48fe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:36.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.652+0000 7f48fe191640 1 Processor -- start 2024-09-18T13:16:36.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.652+0000 7f48fe191640 1 -- start start 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.653+0000 7f48fe191640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f8123920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.653+0000 7f48fe191640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8124dc0 con 0x7f48f809da60 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.653+0000 7f48f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f8123920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.653+0000 7f48f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f8123920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60244/0 (socket says 172.21.15.120:60244) 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.653+0000 7f48f77fe640 1 -- 172.21.15.120:0/3178682695 learned_addr learned my addr 172.21.15.120:0/3178682695 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.653+0000 7f48f77fe640 1 -- 172.21.15.120:0/3178682695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f81253a0 con 0x7f48f809da60 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.653+0000 7f48f77fe640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f8123920 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.654+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f48e800e040 con 0x7f48f809da60 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.654+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f48e8012b00 con 0x7f48f809da60 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.654+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f48e8012da0 con 0x7f48f809da60 2024-09-18T13:16:36.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.654+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f8124ab0 con 0x7f48f809da60 2024-09-18T13:16:36.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.654+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f81261c0 con 0x7f48f809da60 2024-09-18T13:16:36.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.654+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48f80a0d90 con 0x7f48f809da60 2024-09-18T13:16:36.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.655+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f48e80153f0 con 0x7f48f809da60 2024-09-18T13:16:36.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.655+0000 7f48dffff640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f48e403e960 0x7f48e4040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:36.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.655+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f48e8051200 con 0x7f48f809da60 2024-09-18T13:16:36.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.655+0000 7f48dffff640 1 --2- 172.21.15.120:0/3178682695 >> v2:172.21.15.120:6801/1764758402 conn(0x7f48e4044b00 0x7f48e4046ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:36.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.655+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 --> v2:172.21.15.120:6801/1764758402 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48e4047680 con 0x7f48e4044b00 2024-09-18T13:16:36.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.655+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7f48e80536f0 con 0x7f48f809da60 2024-09-18T13:16:36.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.655+0000 7f48f6ffd640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f48e403e960 0x7f48e4040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:36.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.656+0000 7f48f7fff640 1 --2- 172.21.15.120:0/3178682695 >> v2:172.21.15.120:6801/1764758402 conn(0x7f48e4044b00 0x7f48e4046ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:16:36.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.656+0000 7f48f6ffd640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f48e403e960 0x7f48e4040e70 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:36.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.658+0000 7f48f7fff640 1 --2- 172.21.15.120:0/3178682695 >> v2:172.21.15.120:6801/1764758402 conn(0x7f48e4044b00 0x7f48e4046ff0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:36.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.659+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== osd.0 v2:172.21.15.120:6801/1764758402 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f48e4047680 con 0x7f48e4044b00 2024-09-18T13:16:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.663+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 --> v2:172.21.15.120:6801/1764758402 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f48f80a59a0 con 0x7f48e4044b00 2024-09-18T13:16:36.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.664+0000 7f48dffff640 1 -- 172.21.15.120:0/3178682695 <== osd.0 v2:172.21.15.120:6801/1764758402 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f48f0009830 con 0x7f48e4044b00 2024-09-18T13:16:36.665 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-18T13:16:36.665 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "" 2024-09-18T13:16:36.665 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-18T13:16:36.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.664+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 >> v2:172.21.15.120:6801/1764758402 conn(0x7f48e4044b00 msgr2=0x7f48e4046ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.664+0000 7f48fe191640 1 --2- 172.21.15.120:0/3178682695 >> v2:172.21.15.120:6801/1764758402 conn(0x7f48e4044b00 0x7f48e4046ff0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f48e403e960 msgr2=0x7f48e4040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f48e403e960 0x7f48e4040e70 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 msgr2=0x7f48f8123920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f8123920 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 shutdown_connections 2024-09-18T13:16:36.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 --2- 172.21.15.120:0/3178682695 >> v2:172.21.15.120:6801/1764758402 conn(0x7f48e4044b00 0x7f48e4046ff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f48e403e960 0x7f48e4040e70 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 --2- 172.21.15.120:0/3178682695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48f809da60 0x7f48f8123920 unknown :-1 s=CLOSED pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 >> 172.21.15.120:0/3178682695 conn(0x7f48f806eb10 msgr2=0x7f48f80a33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:36.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 shutdown_connections 2024-09-18T13:16:36.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.665+0000 7f48fe191640 1 -- 172.21.15.120:0/3178682695 wait complete. 2024-09-18T13:16:36.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T13:16:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.779+0000 7f3bd6191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.785+0000 7f3bd6191640 1 Processor -- start 2024-09-18T13:16:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.785+0000 7f3bd6191640 1 -- start start 2024-09-18T13:16:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bd6191640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3bd00a26d0 0x7f3bd0131000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bd6191640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd0130bb0 con 0x7f3bd00a2150 2024-09-18T13:16:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bd6191640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd009fb00 con 0x7f3bd00a26d0 2024-09-18T13:16:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bcf7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3bd00a26d0 0x7f3bd0131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bceffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3bd00a2150 0x7f3bd0133fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47716/0 (socket says 172.21.15.120:47716) 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bceffd640 1 -- 172.21.15.120:0/2459195487 learned_addr learned my addr 172.21.15.120:0/2459195487 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bcf7fe640 1 -- 172.21.15.120:0/2459195487 >> v1:172.21.15.120:6789/0 conn(0x7f3bd00a2150 legacy=0x7f3bd0133fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bcf7fe640 1 -- 172.21.15.120:0/2459195487 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd009fc40 con 0x7f3bd00a26d0 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bce7fc640 1 -- 172.21.15.120:0/2459195487 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929711094 0 0) 0x7f3bd0130bb0 con 0x7f3bd00a2150 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bcf7fe640 1 --2- 172.21.15.120:0/2459195487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a26d0 0x7f3bd0131000 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509abecb7c5ea29a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bce7fc640 1 -- 172.21.15.120:0/2459195487 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3bc0009d90 con 0x7f3bd00a26d0 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bce7fc640 1 -- 172.21.15.120:0/2459195487 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3bc000e230 con 0x7f3bd00a26d0 2024-09-18T13:16:36.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.786+0000 7f3bce7fc640 1 -- 172.21.15.120:0/2459195487 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3bc000e4d0 con 0x7f3bd00a26d0 2024-09-18T13:16:36.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.787+0000 7f3bd6191640 1 -- 172.21.15.120:0/2459195487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a26d0 msgr2=0x7f3bd0131000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.787+0000 7f3bd6191640 1 --2- 172.21.15.120:0/2459195487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a26d0 0x7f3bd0131000 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.787+0000 7f3bd6191640 1 -- 172.21.15.120:0/2459195487 shutdown_connections 2024-09-18T13:16:36.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.787+0000 7f3bd6191640 1 --2- 172.21.15.120:0/2459195487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a26d0 0x7f3bd0131000 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.787+0000 7f3bd6191640 1 -- 172.21.15.120:0/2459195487 >> 172.21.15.120:0/2459195487 conn(0x7f3bd00a3310 msgr2=0x7f3bd00a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:36.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.787+0000 7f3bd6191640 1 -- 172.21.15.120:0/2459195487 shutdown_connections 2024-09-18T13:16:36.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.787+0000 7f3bd6191640 1 -- 172.21.15.120:0/2459195487 wait complete. 2024-09-18T13:16:36.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.788+0000 7f3bd6191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:36.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.789+0000 7f3bd6191640 1 Processor -- start 2024-09-18T13:16:36.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.789+0000 7f3bd6191640 1 -- start start 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.790+0000 7f3bd6191640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a2150 0x7f3bd011c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.790+0000 7f3bd6191640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01339f0 con 0x7f3bd00a2150 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.790+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a2150 0x7f3bd011c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.790+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a2150 0x7f3bd011c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60264/0 (socket says 172.21.15.120:60264) 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.790+0000 7f3bcf7fe640 1 -- 172.21.15.120:0/4211487764 learned_addr learned my addr 172.21.15.120:0/4211487764 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.790+0000 7f3bcf7fe640 1 -- 172.21.15.120:0/4211487764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd011dc90 con 0x7f3bd00a2150 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.791+0000 7f3bcf7fe640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a2150 0x7f3bd011c8f0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.791+0000 7f3bb7fff640 1 -- 172.21.15.120:0/4211487764 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3bc0014620 con 0x7f3bd00a2150 2024-09-18T13:16:36.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.791+0000 7f3bb7fff640 1 -- 172.21.15.120:0/4211487764 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3bc0014780 con 0x7f3bd00a2150 2024-09-18T13:16:36.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.791+0000 7f3bb7fff640 1 -- 172.21.15.120:0/4211487764 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3bc0014a20 con 0x7f3bd00a2150 2024-09-18T13:16:36.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.791+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd011e540 con 0x7f3bd00a2150 2024-09-18T13:16:36.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.791+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd011fda0 con 0x7f3bd00a2150 2024-09-18T13:16:36.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.792+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd01200e0 con 0x7f3bd00a2150 2024-09-18T13:16:36.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.792+0000 7f3bb7fff640 1 -- 172.21.15.120:0/4211487764 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3bc0014bd0 con 0x7f3bd00a2150 2024-09-18T13:16:36.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.792+0000 7f3bb7fff640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3bbc03e960 0x7f3bbc040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:36.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.792+0000 7f3bb7fff640 1 -- 172.21.15.120:0/4211487764 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f3bc0019040 con 0x7f3bd00a2150 2024-09-18T13:16:36.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.792+0000 7f3bceffd640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3bbc03e960 0x7f3bbc040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:36.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.793+0000 7f3bceffd640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3bbc03e960 0x7f3bbc040e70 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:36.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.797+0000 7f3bb7fff640 1 -- 172.21.15.120:0/4211487764 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f3bc0011380 con 0x7f3bd00a2150 2024-09-18T13:16:36.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.973+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f3bd0134ae0 con 0x7f3bbc03e960 2024-09-18T13:16:36.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.974+0000 7f3bb7fff640 1 -- 172.21.15.120:0/4211487764 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f3bd0134ae0 con 0x7f3bbc03e960 2024-09-18T13:16:36.975 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T13:16:36.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3bbc03e960 msgr2=0x7f3bbc040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3bbc03e960 0x7f3bbc040e70 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a2150 msgr2=0x7f3bd011c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:36.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a2150 0x7f3bd011c8f0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 shutdown_connections 2024-09-18T13:16:36.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3bbc03e960 0x7f3bbc040e70 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 --2- 172.21.15.120:0/4211487764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00a2150 0x7f3bd011c8f0 unknown :-1 s=CLOSED pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:36.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 >> 172.21.15.120:0/4211487764 conn(0x7f3bd00a3310 msgr2=0x7f3bd0130dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:36.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 shutdown_connections 2024-09-18T13:16:36.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:36.976+0000 7f3bd6191640 1 -- 172.21.15.120:0/4211487764 wait complete. 2024-09-18T13:16:36.996 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T13:16:36.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T13:16:37.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.099+0000 7f4f53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.109+0000 7f4f53791640 1 Processor -- start 2024-09-18T13:16:37.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.109+0000 7f4f53791640 1 -- start start 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f53791640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4f4c09da60 0x7f4f4c09de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f53791640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c09ee20 con 0x7f4f4c09e3b0 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f53791640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c09f560 con 0x7f4f4c09da60 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f5152d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4f4c09da60 0x7f4f4c09de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f50d2c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4f4c09e3b0 0x7f4f4c135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47720/0 (socket says 172.21.15.120:47720) 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f50d2c640 1 -- 172.21.15.120:0/1727474147 learned_addr learned my addr 172.21.15.120:0/1727474147 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f5152d640 1 -- 172.21.15.120:0/1727474147 >> v1:172.21.15.120:6789/0 conn(0x7f4f4c09e3b0 legacy=0x7f4f4c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f5152d640 1 -- 172.21.15.120:0/1727474147 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c09eb10 con 0x7f4f4c09da60 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.110+0000 7f4f4bfff640 1 -- 172.21.15.120:0/1727474147 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567030805 0 0) 0x7f4f4c09ee20 con 0x7f4f4c09e3b0 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f5152d640 1 --2- 172.21.15.120:0/1727474147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c09de70 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf749590803efed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f4bfff640 1 -- 172.21.15.120:0/1727474147 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f3c00e040 con 0x7f4f4c09da60 2024-09-18T13:16:37.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f4bfff640 1 -- 172.21.15.120:0/1727474147 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f3c007670 con 0x7f4f4c09da60 2024-09-18T13:16:37.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f4bfff640 1 -- 172.21.15.120:0/1727474147 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f3c007910 con 0x7f4f4c09da60 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f53791640 1 -- 172.21.15.120:0/1727474147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 msgr2=0x7f4f4c09de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f53791640 1 --2- 172.21.15.120:0/1727474147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c09de70 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f53791640 1 -- 172.21.15.120:0/1727474147 shutdown_connections 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f53791640 1 --2- 172.21.15.120:0/1727474147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c09de70 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.111+0000 7f4f53791640 1 -- 172.21.15.120:0/1727474147 >> 172.21.15.120:0/1727474147 conn(0x7f4f4c06eb10 msgr2=0x7f4f4c06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.112+0000 7f4f53791640 1 -- 172.21.15.120:0/1727474147 shutdown_connections 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.112+0000 7f4f53791640 1 -- 172.21.15.120:0/1727474147 wait complete. 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.112+0000 7f4f53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.113+0000 7f4f53791640 1 Processor -- start 2024-09-18T13:16:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.113+0000 7f4f53791640 1 -- start start 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.114+0000 7f4f53791640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c124090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.114+0000 7f4f53791640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c123c60 con 0x7f4f4c09da60 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.114+0000 7f4f5152d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c124090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.114+0000 7f4f5152d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c124090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60280/0 (socket says 172.21.15.120:60280) 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.114+0000 7f4f5152d640 1 -- 172.21.15.120:0/2492604082 learned_addr learned my addr 172.21.15.120:0/2492604082 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.115+0000 7f4f5152d640 1 -- 172.21.15.120:0/2492604082 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c1251d0 con 0x7f4f4c09da60 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.115+0000 7f4f5152d640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c124090 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.115+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f3c00e040 con 0x7f4f4c09da60 2024-09-18T13:16:37.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.115+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f3c012b00 con 0x7f4f4c09da60 2024-09-18T13:16:37.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.115+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f3c012da0 con 0x7f4f4c09da60 2024-09-18T13:16:37.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.115+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c123950 con 0x7f4f4c09da60 2024-09-18T13:16:37.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.115+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c126b70 con 0x7f4f4c09da60 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.116+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4f3c0153f0 con 0x7f4f4c09da60 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.116+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f4c127860 con 0x7f4f4c09da60 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.116+0000 7f4f49ffb640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4f3803e930 0x7f4f38040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.116+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f4f3c051280 con 0x7f4f4c09da60 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.117+0000 7f4f49ffb640 1 --2- 172.21.15.120:0/2492604082 >> v2:172.21.15.120:6803/3478481720 conn(0x7f4f38044a70 0x7f4f38046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.117+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 --> v2:172.21.15.120:6803/3478481720 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f380475f0 con 0x7f4f38044a70 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.117+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7f4f3c0536f0 con 0x7f4f4c09da60 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.117+0000 7f4f50d2c640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4f3803e930 0x7f4f38040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.117+0000 7f4f51d2e640 1 --2- 172.21.15.120:0/2492604082 >> v2:172.21.15.120:6803/3478481720 conn(0x7f4f38044a70 0x7f4f38046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:16:37.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.117+0000 7f4f50d2c640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4f3803e930 0x7f4f38040e40 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.120+0000 7f4f51d2e640 1 --2- 172.21.15.120:0/2492604082 >> v2:172.21.15.120:6803/3478481720 conn(0x7f4f38044a70 0x7f4f38046f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.121+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== osd.1 v2:172.21.15.120:6803/3478481720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f4f380475f0 con 0x7f4f38044a70 2024-09-18T13:16:37.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.124+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 --> v2:172.21.15.120:6803/3478481720 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4f4c126240 con 0x7f4f38044a70 2024-09-18T13:16:37.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.125+0000 7f4f49ffb640 1 -- 172.21.15.120:0/2492604082 <== osd.1 v2:172.21.15.120:6803/3478481720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f4f4c126240 con 0x7f4f38044a70 2024-09-18T13:16:37.126 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-18T13:16:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "" 2024-09-18T13:16:37.127 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-18T13:16:37.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 >> v2:172.21.15.120:6803/3478481720 conn(0x7f4f38044a70 msgr2=0x7f4f38046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 --2- 172.21.15.120:0/2492604082 >> v2:172.21.15.120:6803/3478481720 conn(0x7f4f38044a70 0x7f4f38046f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4f3803e930 msgr2=0x7f4f38040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4f3803e930 0x7f4f38040e40 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 msgr2=0x7f4f4c124090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c124090 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 shutdown_connections 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 --2- 172.21.15.120:0/2492604082 >> v2:172.21.15.120:6803/3478481720 conn(0x7f4f38044a70 0x7f4f38046f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f4f3803e930 0x7f4f38040e40 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 --2- 172.21.15.120:0/2492604082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c09da60 0x7f4f4c124090 unknown :-1 s=CLOSED pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 >> 172.21.15.120:0/2492604082 conn(0x7f4f4c06eb10 msgr2=0x7f4f4c0a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 shutdown_connections 2024-09-18T13:16:37.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.126+0000 7f4f53791640 1 -- 172.21.15.120:0/2492604082 wait complete. 2024-09-18T13:16:37.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T13:16:37.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.240+0000 7f9a1ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.246+0000 7f9a1ad91640 1 Processor -- start 2024-09-18T13:16:37.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.246+0000 7f9a1ad91640 1 -- start start 2024-09-18T13:16:37.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.247+0000 7f9a1ad91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9a14135570 0x7f9a14137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.247+0000 7f9a1ad91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a14098840 con 0x7f9a14132790 2024-09-18T13:16:37.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.247+0000 7f9a1ad91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1409ac90 con 0x7f9a14135570 2024-09-18T13:16:37.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.247+0000 7f9a18b2d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9a14132790 0x7f9a14132ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47722/0 (socket says 172.21.15.120:47722) 2024-09-18T13:16:37.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a18b2d640 1 -- 172.21.15.120:0/3622632468 learned_addr learned my addr 172.21.15.120:0/3622632468 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0bfff640 1 --2- 172.21.15.120:0/3622632468 >> v2:172.21.15.120:3300/0 conn(0x7f9a14135570 0x7f9a14137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0b7fe640 1 -- 172.21.15.120:0/3622632468 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243453553 0 0) 0x7f9a14098840 con 0x7f9a14132790 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0b7fe640 1 -- 172.21.15.120:0/3622632468 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99fc003580 con 0x7f9a14132790 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0bfff640 1 -- 172.21.15.120:0/3622632468 >> v1:172.21.15.120:6789/0 conn(0x7f9a14132790 legacy=0x7f9a14132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0bfff640 1 -- 172.21.15.120:0/3622632468 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1409cb70 con 0x7f9a14135570 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0bfff640 1 --2- 172.21.15.120:0/3622632468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14135570 0x7f9a14137990 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff079c109d301ea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0b7fe640 1 -- 172.21.15.120:0/3622632468 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a04009d80 con 0x7f9a14135570 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0b7fe640 1 -- 172.21.15.120:0/3622632468 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a0400e230 con 0x7f9a14135570 2024-09-18T13:16:37.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.248+0000 7f9a0b7fe640 1 -- 172.21.15.120:0/3622632468 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a0400e4d0 con 0x7f9a14135570 2024-09-18T13:16:37.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 1 -- 172.21.15.120:0/3622632468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14135570 msgr2=0x7f9a14137990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 1 --2- 172.21.15.120:0/3622632468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14135570 0x7f9a14137990 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 1 -- 172.21.15.120:0/3622632468 shutdown_connections 2024-09-18T13:16:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 1 --2- 172.21.15.120:0/3622632468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14135570 0x7f9a14137990 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 1 -- 172.21.15.120:0/3622632468 >> 172.21.15.120:0/3622632468 conn(0x7f9a140a11f0 msgr2=0x7f9a140a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 1 -- 172.21.15.120:0/3622632468 shutdown_connections 2024-09-18T13:16:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 1 -- 172.21.15.120:0/3622632468 wait complete. 2024-09-18T13:16:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.249+0000 7f9a1ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.250+0000 7f9a1ad91640 1 Processor -- start 2024-09-18T13:16:37.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.250+0000 7f9a1ad91640 1 -- start start 2024-09-18T13:16:37.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a1ad91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14132790 0x7f9a14129bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a1ad91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14129340 con 0x7f9a14132790 2024-09-18T13:16:37.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a18b2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14132790 0x7f9a14129bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a18b2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14132790 0x7f9a14129bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60300/0 (socket says 172.21.15.120:60300) 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a18b2d640 1 -- 172.21.15.120:0/2017314139 learned_addr learned my addr 172.21.15.120:0/2017314139 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a18b2d640 1 -- 172.21.15.120:0/2017314139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1412a2f0 con 0x7f9a14132790 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a18b2d640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14132790 0x7f9a14129bd0 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a097fa640 1 -- 172.21.15.120:0/2017314139 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a10005a60 con 0x7f9a14132790 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a097fa640 1 -- 172.21.15.120:0/2017314139 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a10005bc0 con 0x7f9a14132790 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a14073c20 con 0x7f9a14132790 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a097fa640 1 -- 172.21.15.120:0/2017314139 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a10005e60 con 0x7f9a14132790 2024-09-18T13:16:37.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.252+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a14130020 con 0x7f9a14132790 2024-09-18T13:16:37.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.253+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a14132ba0 con 0x7f9a14132790 2024-09-18T13:16:37.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.253+0000 7f9a097fa640 1 -- 172.21.15.120:0/2017314139 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9a100070b0 con 0x7f9a14132790 2024-09-18T13:16:37.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.254+0000 7f9a097fa640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9a0003f9f0 0x7f9a00041f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.254+0000 7f9a097fa640 1 -- 172.21.15.120:0/2017314139 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f9a1004f930 con 0x7f9a14132790 2024-09-18T13:16:37.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.254+0000 7f9a0bfff640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9a0003f9f0 0x7f9a00041f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.254+0000 7f9a0bfff640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9a0003f9f0 0x7f9a00041f00 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.259+0000 7f9a097fa640 1 -- 172.21.15.120:0/2017314139 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f9a1000dc60 con 0x7f9a14132790 2024-09-18T13:16:37.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.435+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9a1409df90 con 0x7f9a0003f9f0 2024-09-18T13:16:37.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.436+0000 7f9a097fa640 1 -- 172.21.15.120:0/2017314139 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f9a04009d50 con 0x7f9a0003f9f0 2024-09-18T13:16:37.437 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.438+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9a0003f9f0 msgr2=0x7f9a00041f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.438+0000 7f9a1ad91640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9a0003f9f0 0x7f9a00041f00 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.438+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14132790 msgr2=0x7f9a14129bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.438+0000 7f9a1ad91640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14132790 0x7f9a14129bd0 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.439+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 shutdown_connections 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.439+0000 7f9a1ad91640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f9a0003f9f0 0x7f9a00041f00 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.439+0000 7f9a1ad91640 1 --2- 172.21.15.120:0/2017314139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a14132790 0x7f9a14129bd0 unknown :-1 s=CLOSED pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.439+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 >> 172.21.15.120:0/2017314139 conn(0x7f9a140a11f0 msgr2=0x7f9a140974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.439+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 shutdown_connections 2024-09-18T13:16:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.439+0000 7f9a1ad91640 1 -- 172.21.15.120:0/2017314139 wait complete. 2024-09-18T13:16:37.461 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T13:16:37.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T13:16:37.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.566+0000 7f2f50908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.575+0000 7f2f50908640 1 Processor -- start 2024-09-18T13:16:37.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.575+0000 7f2f50908640 1 -- start start 2024-09-18T13:16:37.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f50908640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2f4c09b0b0 0x7f2f4c09c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f50908640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f4c075120 con 0x7f2f4c09b7f0 2024-09-18T13:16:37.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f50908640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f2f4c09d620 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f49d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2f4c09b0b0 0x7f2f4c09c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f4a59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2f4c09b7f0 0x7f2f4c09bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47726/0 (socket says 172.21.15.120:47726) 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f4a59c640 1 -- 172.21.15.120:0/3608410262 learned_addr learned my addr 172.21.15.120:0/3608410262 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f49d9b640 1 -- 172.21.15.120:0/3608410262 >> v1:172.21.15.120:6789/0 conn(0x7f2f4c09b7f0 legacy=0x7f2f4c09bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f4959a640 1 -- 172.21.15.120:0/3608410262 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345114953 0 0) 0x7f2f4c075120 con 0x7f2f4c09b7f0 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f49d9b640 1 -- 172.21.15.120:0/3608410262 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c09cb10 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f49d9b640 1 --2- 172.21.15.120:0/3608410262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c09c310 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86a4d8a346b13e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f4959a640 1 -- 172.21.15.120:0/3608410262 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f4000ad20 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f4959a640 1 -- 172.21.15.120:0/3608410262 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f4000ae80 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.577+0000 7f2f4959a640 1 -- 172.21.15.120:0/3608410262 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f4000f470 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 1 -- 172.21.15.120:0/3608410262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 msgr2=0x7f2f4c09c310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 1 --2- 172.21.15.120:0/3608410262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c09c310 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 1 -- 172.21.15.120:0/3608410262 shutdown_connections 2024-09-18T13:16:37.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 1 --2- 172.21.15.120:0/3608410262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c09c310 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 1 -- 172.21.15.120:0/3608410262 >> 172.21.15.120:0/3608410262 conn(0x7f2f4c0a1580 msgr2=0x7f2f4c09ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 1 -- 172.21.15.120:0/3608410262 shutdown_connections 2024-09-18T13:16:37.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 1 -- 172.21.15.120:0/3608410262 wait complete. 2024-09-18T13:16:37.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.578+0000 7f2f50908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.580+0000 7f2f50908640 1 Processor -- start 2024-09-18T13:16:37.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.580+0000 7f2f50908640 1 -- start start 2024-09-18T13:16:37.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.581+0000 7f2f50908640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c1c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.581+0000 7f2f50908640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c12ed50 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.581+0000 7f2f4a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c1c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.581+0000 7f2f4a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c1c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60308/0 (socket says 172.21.15.120:60308) 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.581+0000 7f2f4a59c640 1 -- 172.21.15.120:0/636287445 learned_addr learned my addr 172.21.15.120:0/636287445 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.581+0000 7f2f4a59c640 1 -- 172.21.15.120:0/636287445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c074250 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.581+0000 7f2f4a59c640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c1c6740 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.582+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f3c0070b0 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.582+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f3c007210 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.582+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4c130640 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.582+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f3c0074b0 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.582+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4c131240 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.582+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f4c132cd0 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.583+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2f3c007660 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.583+0000 7f2f3affd640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2f2c03e930 0x7f2f2c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.583+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f2f3c050390 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.583+0000 7f2f3affd640 1 --2- 172.21.15.120:0/636287445 >> v2:172.21.15.176:6802/1480150686 conn(0x7f2f2c044ad0 0x7f2f2c046fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.583+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 --> v2:172.21.15.176:6802/1480150686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f2c047650 con 0x7f2f2c044ad0 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.583+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7f2f3c052880 con 0x7f2f4c09b0b0 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.583+0000 7f2f49d9b640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2f2c03e930 0x7f2f2c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.584+0000 7f2f49d9b640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2f2c03e930 0x7f2f2c040e40 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.585+0000 7f2f4ad9d640 1 --2- 172.21.15.120:0/636287445 >> v2:172.21.15.176:6802/1480150686 conn(0x7f2f2c044ad0 0x7f2f2c046fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:16:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.589+0000 7f2f4ad9d640 1 --2- 172.21.15.120:0/636287445 >> v2:172.21.15.176:6802/1480150686 conn(0x7f2f2c044ad0 0x7f2f2c046fc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.591+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== osd.2 v2:172.21.15.176:6802/1480150686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f2f2c047650 con 0x7f2f2c044ad0 2024-09-18T13:16:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.594+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 --> v2:172.21.15.176:6802/1480150686 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2f4c06f440 con 0x7f2f2c044ad0 2024-09-18T13:16:37.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.596+0000 7f2f3affd640 1 -- 172.21.15.120:0/636287445 <== osd.2 v2:172.21.15.176:6802/1480150686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f2f44009830 con 0x7f2f2c044ad0 2024-09-18T13:16:37.597 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-18T13:16:37.597 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "" 2024-09-18T13:16:37.597 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-18T13:16:37.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 >> v2:172.21.15.176:6802/1480150686 conn(0x7f2f2c044ad0 msgr2=0x7f2f2c046fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 --2- 172.21.15.120:0/636287445 >> v2:172.21.15.176:6802/1480150686 conn(0x7f2f2c044ad0 0x7f2f2c046fc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2f2c03e930 msgr2=0x7f2f2c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2f2c03e930 0x7f2f2c040e40 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 msgr2=0x7f2f4c1c6740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c1c6740 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 shutdown_connections 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 --2- 172.21.15.120:0/636287445 >> v2:172.21.15.176:6802/1480150686 conn(0x7f2f2c044ad0 0x7f2f2c046fc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2f2c03e930 0x7f2f2c040e40 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 --2- 172.21.15.120:0/636287445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f4c09b0b0 0x7f2f4c1c6740 unknown :-1 s=CLOSED pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 >> 172.21.15.120:0/636287445 conn(0x7f2f4c0a1580 msgr2=0x7f2f4c074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 shutdown_connections 2024-09-18T13:16:37.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.597+0000 7f2f50908640 1 -- 172.21.15.120:0/636287445 wait complete. 2024-09-18T13:16:37.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T13:16:37.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.711+0000 7fc3fff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.717+0000 7fc3fff91640 1 Processor -- start 2024-09-18T13:16:37.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.717+0000 7fc3fff91640 1 -- start start 2024-09-18T13:16:37.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.718+0000 7fc3fff91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc3f8132790 0x7fc3f8132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.718+0000 7fc3fff91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f8098840 con 0x7fc3f809b680 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.718+0000 7fc3fff91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f809ac90 con 0x7fc3f8132790 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fdd2d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc3f8132790 0x7fc3f8132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fd52c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc3f809b680 0x7fc3f809ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47736/0 (socket says 172.21.15.120:47736) 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fd52c640 1 -- 172.21.15.120:0/1737683601 learned_addr learned my addr 172.21.15.120:0/1737683601 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fdd2d640 1 -- 172.21.15.120:0/1737683601 >> v1:172.21.15.120:6789/0 conn(0x7fc3f809b680 legacy=0x7fc3f809ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fdd2d640 1 -- 172.21.15.120:0/1737683601 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f809cb70 con 0x7fc3f8132790 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fcd2b640 1 -- 172.21.15.120:0/1737683601 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101870336 0 0) 0x7fc3f8098840 con 0x7fc3f809b680 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fdd2d640 1 --2- 172.21.15.120:0/1737683601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f8132790 0x7fc3f8132ba0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7992950526a2a90a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fcd2b640 1 -- 172.21.15.120:0/1737683601 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3f400ad10 con 0x7fc3f8132790 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fcd2b640 1 -- 172.21.15.120:0/1737683601 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3f400ae70 con 0x7fc3f8132790 2024-09-18T13:16:37.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.719+0000 7fc3fcd2b640 1 -- 172.21.15.120:0/1737683601 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3f400f470 con 0x7fc3f8132790 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 1 -- 172.21.15.120:0/1737683601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f8132790 msgr2=0x7fc3f8132ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 1 --2- 172.21.15.120:0/1737683601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f8132790 0x7fc3f8132ba0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 1 -- 172.21.15.120:0/1737683601 shutdown_connections 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 1 --2- 172.21.15.120:0/1737683601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f8132790 0x7fc3f8132ba0 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 1 -- 172.21.15.120:0/1737683601 >> 172.21.15.120:0/1737683601 conn(0x7fc3f80a11f0 msgr2=0x7fc3f80a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 1 -- 172.21.15.120:0/1737683601 shutdown_connections 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 1 -- 172.21.15.120:0/1737683601 wait complete. 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.720+0000 7fc3fff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.722+0000 7fc3fff91640 1 Processor -- start 2024-09-18T13:16:37.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.722+0000 7fc3fff91640 1 -- start start 2024-09-18T13:16:37.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fff91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f809b680 0x7fc3f812fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fff91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f812c830 con 0x7fc3f809b680 2024-09-18T13:16:37.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fdd2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f809b680 0x7fc3f812fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fdd2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f809b680 0x7fc3f812fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60330/0 (socket says 172.21.15.120:60330) 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fdd2d640 1 -- 172.21.15.120:0/868864816 learned_addr learned my addr 172.21.15.120:0/868864816 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fdd2d640 1 -- 172.21.15.120:0/868864816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f812caf0 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fdd2d640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f809b680 0x7fc3f812fdc0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3ee7fc640 1 -- 172.21.15.120:0/868864816 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3f4017040 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3ee7fc640 1 -- 172.21.15.120:0/868864816 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3f400fdc0 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3ee7fc640 1 -- 172.21.15.120:0/868864816 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3f4011550 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f812b1b0 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.723+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f812b7a0 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.724+0000 7fc3ee7fc640 1 -- 172.21.15.120:0/868864816 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc3f401a040 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.724+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f809e480 con 0x7fc3f809b680 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.724+0000 7fc3ee7fc640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc3dc03e930 0x7fc3dc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:37.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.725+0000 7fc3ee7fc640 1 -- 172.21.15.120:0/868864816 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7fc3f4051b30 con 0x7fc3f809b680 2024-09-18T13:16:37.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.725+0000 7fc3fd52c640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc3dc03e930 0x7fc3dc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:37.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.725+0000 7fc3fd52c640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc3dc03e930 0x7fc3dc040e40 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:37.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.730+0000 7fc3ee7fc640 1 -- 172.21.15.120:0/868864816 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7fc3f4010740 con 0x7fc3f809b680 2024-09-18T13:16:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.906+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc3f809df90 con 0x7fc3dc03e930 2024-09-18T13:16:37.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.907+0000 7fc3ee7fc640 1 -- 172.21.15.120:0/868864816 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fc3e80070b0 con 0x7fc3dc03e930 2024-09-18T13:16:37.908 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc3dc03e930 msgr2=0x7fc3dc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc3dc03e930 0x7fc3dc040e40 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f809b680 msgr2=0x7fc3f812fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f809b680 0x7fc3f812fdc0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 shutdown_connections 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7fc3dc03e930 0x7fc3dc040e40 unknown :-1 s=CLOSED pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 --2- 172.21.15.120:0/868864816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3f809b680 0x7fc3f812fdc0 unknown :-1 s=CLOSED pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 >> 172.21.15.120:0/868864816 conn(0x7fc3f80a11f0 msgr2=0x7fc3f80a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 shutdown_connections 2024-09-18T13:16:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:37.909+0000 7fc3fff91640 1 -- 172.21.15.120:0/868864816 wait complete. 2024-09-18T13:16:37.923 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T13:16:37.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T13:16:38.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.026+0000 7faedad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:38.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.035+0000 7faedad91640 1 Processor -- start 2024-09-18T13:16:38.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.035+0000 7faedad91640 1 -- start start 2024-09-18T13:16:38.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.036+0000 7faedad91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faed409d010 0x7faed4138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faedad91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed409e030 con 0x7faed409e480 2024-09-18T13:16:38.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faedad91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7faed409e890 con 0x7faed409d010 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faed409d010 0x7faed4138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed8b2d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7faed409e480 0x7faed409c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47752/0 (socket says 172.21.15.120:47752) 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed8b2d640 1 -- 172.21.15.120:0/1681608948 learned_addr learned my addr 172.21.15.120:0/1681608948 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed3fff640 1 -- 172.21.15.120:0/1681608948 >> v1:172.21.15.120:6789/0 conn(0x7faed409e480 legacy=0x7faed409c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed3fff640 1 -- 172.21.15.120:0/1681608948 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed4075190 con 0x7faed409d010 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed37fe640 1 -- 172.21.15.120:0/1681608948 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496202472 0 0) 0x7faed409e030 con 0x7faed409e480 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed3fff640 1 --2- 172.21.15.120:0/1681608948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed4138480 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b4bef18df625d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed37fe640 1 -- 172.21.15.120:0/1681608948 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faec400e040 con 0x7faed409d010 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed37fe640 1 -- 172.21.15.120:0/1681608948 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faec4007670 con 0x7faed409d010 2024-09-18T13:16:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.037+0000 7faed37fe640 1 -- 172.21.15.120:0/1681608948 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faec4007910 con 0x7faed409d010 2024-09-18T13:16:38.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 1 -- 172.21.15.120:0/1681608948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 msgr2=0x7faed4138480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 1 --2- 172.21.15.120:0/1681608948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed4138480 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 1 -- 172.21.15.120:0/1681608948 shutdown_connections 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 1 --2- 172.21.15.120:0/1681608948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed4138480 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 1 -- 172.21.15.120:0/1681608948 >> 172.21.15.120:0/1681608948 conn(0x7faed40a1580 msgr2=0x7faed409ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 1 -- 172.21.15.120:0/1681608948 shutdown_connections 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 1 -- 172.21.15.120:0/1681608948 wait complete. 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.038+0000 7faedad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.040+0000 7faedad91640 1 Processor -- start 2024-09-18T13:16:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.040+0000 7faedad91640 1 -- start start 2024-09-18T13:16:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.041+0000 7faedad91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed409ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.041+0000 7faedad91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faed40995e0 con 0x7faed409d010 2024-09-18T13:16:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.041+0000 7faed8b2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed409ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.041+0000 7faed8b2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed409ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60350/0 (socket says 172.21.15.120:60350) 2024-09-18T13:16:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.041+0000 7faed8b2d640 1 -- 172.21.15.120:0/3014074175 learned_addr learned my addr 172.21.15.120:0/3014074175 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.041+0000 7faed8b2d640 1 -- 172.21.15.120:0/3014074175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed4099c50 con 0x7faed409d010 2024-09-18T13:16:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.042+0000 7faed8b2d640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed409ab80 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.042+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faecc005a60 con 0x7faed409d010 2024-09-18T13:16:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.042+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed409c150 con 0x7faed409d010 2024-09-18T13:16:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.042+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faecc005bc0 con 0x7faed409d010 2024-09-18T13:16:38.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.042+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faecc005e60 con 0x7faed409d010 2024-09-18T13:16:38.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.042+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed4099060 con 0x7faed409d010 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7faecc0070b0 con 0x7faed409d010 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faed40a2dc0 con 0x7faed409d010 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faed17fa640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7faeb403e8e0 0x7faeb4040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7faecc04f950 con 0x7faed409d010 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faed17fa640 1 --2- 172.21.15.120:0/3014074175 >> v2:172.21.15.176:6806/2606993558 conn(0x7faeb4044a20 0x7faeb4046f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 --> v2:172.21.15.176:6806/2606993558 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faeb40475a0 con 0x7faeb4044a20 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7faecc04fde0 con 0x7faed409d010 2024-09-18T13:16:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.043+0000 7faed3fff640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7faeb403e8e0 0x7faeb4040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.044+0000 7faed3fff640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7faeb403e8e0 0x7faeb4040df0 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.044+0000 7faed932e640 1 --2- 172.21.15.120:0/3014074175 >> v2:172.21.15.176:6806/2606993558 conn(0x7faeb4044a20 0x7faeb4046f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-18T13:16:38.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.049+0000 7faed932e640 1 --2- 172.21.15.120:0/3014074175 >> v2:172.21.15.176:6806/2606993558 conn(0x7faeb4044a20 0x7faeb4046f10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.051+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== osd.3 v2:172.21.15.176:6806/2606993558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7faeb40475a0 con 0x7faeb4044a20 2024-09-18T13:16:38.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.054+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 --> v2:172.21.15.176:6806/2606993558 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faed40987f0 con 0x7faeb4044a20 2024-09-18T13:16:38.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faed17fa640 1 -- 172.21.15.120:0/3014074175 <== osd.3 v2:172.21.15.176:6806/2606993558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7faed40987f0 con 0x7faeb4044a20 2024-09-18T13:16:38.057 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-18T13:16:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "" 2024-09-18T13:16:38.057 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 >> v2:172.21.15.176:6806/2606993558 conn(0x7faeb4044a20 msgr2=0x7faeb4046f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 --2- 172.21.15.120:0/3014074175 >> v2:172.21.15.176:6806/2606993558 conn(0x7faeb4044a20 0x7faeb4046f10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7faeb403e8e0 msgr2=0x7faeb4040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7faeb403e8e0 0x7faeb4040df0 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 msgr2=0x7faed409ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed409ab80 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 shutdown_connections 2024-09-18T13:16:38.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 --2- 172.21.15.120:0/3014074175 >> v2:172.21.15.176:6806/2606993558 conn(0x7faeb4044a20 0x7faeb4046f10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7faeb403e8e0 0x7faeb4040df0 unknown :-1 s=CLOSED pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 --2- 172.21.15.120:0/3014074175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faed409d010 0x7faed409ab80 unknown :-1 s=CLOSED pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 >> 172.21.15.120:0/3014074175 conn(0x7faed40a1580 msgr2=0x7faed408dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 shutdown_connections 2024-09-18T13:16:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.056+0000 7faedad91640 1 -- 172.21.15.120:0/3014074175 wait complete. 2024-09-18T13:16:38.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T13:16:38.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.170+0000 7f13db511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:38.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.176+0000 7f13db511640 1 Processor -- start 2024-09-18T13:16:38.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.176+0000 7f13db511640 1 -- start start 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.177+0000 7f13db511640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f13d40a44a0 0x7f13d412f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.177+0000 7f13db511640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d412f370 con 0x7f13d412fb50 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.177+0000 7f13db511640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f13d406d1d0 con 0x7f13d40a44a0 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13d92ad640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f13d40a44a0 0x7f13d412f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13d8aac640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f13d412fb50 0x7f13d409db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47764/0 (socket says 172.21.15.120:47764) 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13d8aac640 1 -- 172.21.15.120:0/2410921272 learned_addr learned my addr 172.21.15.120:0/2410921272 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13d92ad640 1 -- 172.21.15.120:0/2410921272 >> v1:172.21.15.120:6789/0 conn(0x7f13d412fb50 legacy=0x7f13d409db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13d92ad640 1 -- 172.21.15.120:0/2410921272 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d409ebe0 con 0x7f13d40a44a0 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13cbfff640 1 -- 172.21.15.120:0/2410921272 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194021178 0 0) 0x7f13d412f370 con 0x7f13d412fb50 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13d92ad640 1 --2- 172.21.15.120:0/2410921272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d412f610 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1d7a091ffaa05d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13cbfff640 1 -- 172.21.15.120:0/2410921272 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13d0009d80 con 0x7f13d40a44a0 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13cbfff640 1 -- 172.21.15.120:0/2410921272 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f13d000e230 con 0x7f13d40a44a0 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.178+0000 7f13cbfff640 1 -- 172.21.15.120:0/2410921272 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13d000e4d0 con 0x7f13d40a44a0 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 1 -- 172.21.15.120:0/2410921272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 msgr2=0x7f13d412f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 1 --2- 172.21.15.120:0/2410921272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d412f610 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 1 -- 172.21.15.120:0/2410921272 shutdown_connections 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 1 --2- 172.21.15.120:0/2410921272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d412f610 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 1 -- 172.21.15.120:0/2410921272 >> 172.21.15.120:0/2410921272 conn(0x7f13d40a2970 msgr2=0x7f13d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 1 -- 172.21.15.120:0/2410921272 shutdown_connections 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 1 -- 172.21.15.120:0/2410921272 wait complete. 2024-09-18T13:16:38.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.179+0000 7f13db511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:38.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.181+0000 7f13db511640 1 Processor -- start 2024-09-18T13:16:38.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.181+0000 7f13db511640 1 -- start start 2024-09-18T13:16:38.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13db511640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d4133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13db511640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f13d41350e0 con 0x7f13d40a44a0 2024-09-18T13:16:38.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13d92ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d4133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13d92ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d4133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60372/0 (socket says 172.21.15.120:60372) 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13d92ad640 1 -- 172.21.15.120:0/2110519899 learned_addr learned my addr 172.21.15.120:0/2110519899 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13d92ad640 1 -- 172.21.15.120:0/2110519899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d41386c0 con 0x7f13d40a44a0 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13d92ad640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d4133c40 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13c9ffb640 1 -- 172.21.15.120:0/2110519899 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13d0014620 con 0x7f13d40a44a0 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13c9ffb640 1 -- 172.21.15.120:0/2110519899 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f13d0014780 con 0x7f13d40a44a0 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d4135510 con 0x7f13d40a44a0 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.182+0000 7f13c9ffb640 1 -- 172.21.15.120:0/2110519899 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13d0014a20 con 0x7f13d40a44a0 2024-09-18T13:16:38.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.183+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d412e690 con 0x7f13d40a44a0 2024-09-18T13:16:38.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.183+0000 7f13c9ffb640 1 -- 172.21.15.120:0/2110519899 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f13d0014bd0 con 0x7f13d40a44a0 2024-09-18T13:16:38.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.183+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d41363f0 con 0x7f13d40a44a0 2024-09-18T13:16:38.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.184+0000 7f13c9ffb640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f13b803e930 0x7f13b8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.184+0000 7f13c9ffb640 1 -- 172.21.15.120:0/2110519899 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f13d0019040 con 0x7f13d40a44a0 2024-09-18T13:16:38.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.184+0000 7f13d8aac640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f13b803e930 0x7f13b8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.185+0000 7f13d8aac640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f13b803e930 0x7f13b8040e40 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.189+0000 7f13c9ffb640 1 -- 172.21.15.120:0/2110519899 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f13d0011380 con 0x7f13d40a44a0 2024-09-18T13:16:38.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.364+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f13d406fcf0 con 0x7f13b803e930 2024-09-18T13:16:38.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.365+0000 7f13c9ffb640 1 -- 172.21.15.120:0/2110519899 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f13c40012b0 con 0x7f13b803e930 2024-09-18T13:16:38.366 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.367+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f13b803e930 msgr2=0x7f13b8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.367+0000 7f13db511640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f13b803e930 0x7f13b8040e40 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.367+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 msgr2=0x7f13d4133c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.367+0000 7f13db511640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d4133c40 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.368+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 shutdown_connections 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.368+0000 7f13db511640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f13b803e930 0x7f13b8040e40 unknown :-1 s=CLOSED pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.368+0000 7f13db511640 1 --2- 172.21.15.120:0/2110519899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13d40a44a0 0x7f13d4133c40 unknown :-1 s=CLOSED pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.368+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 >> 172.21.15.120:0/2110519899 conn(0x7f13d40a2970 msgr2=0x7f13d409d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.368+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 shutdown_connections 2024-09-18T13:16:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.368+0000 7f13db511640 1 -- 172.21.15.120:0/2110519899 wait complete. 2024-09-18T13:16:38.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:16:38.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.488+0000 7f3c99d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:38.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.493+0000 7f3c99d11640 1 Processor -- start 2024-09-18T13:16:38.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.493+0000 7f3c99d11640 1 -- start start 2024-09-18T13:16:38.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.494+0000 7f3c99d11640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3c94135570 0x7f3c94137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.494+0000 7f3c99d11640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c94098840 con 0x7f3c94132790 2024-09-18T13:16:38.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.494+0000 7f3c99d11640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f3c9409ac90 con 0x7f3c94135570 2024-09-18T13:16:38.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c92ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3c94135570 0x7f3c94137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c937fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3c94132790 0x7f3c94132ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47780/0 (socket says 172.21.15.120:47780) 2024-09-18T13:16:38.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c937fe640 1 -- 172.21.15.120:0/3002050822 learned_addr learned my addr 172.21.15.120:0/3002050822 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:38.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c92ffd640 1 -- 172.21.15.120:0/3002050822 >> v1:172.21.15.120:6789/0 conn(0x7f3c94132790 legacy=0x7f3c94132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c92ffd640 1 -- 172.21.15.120:0/3002050822 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9409cb70 con 0x7f3c94135570 2024-09-18T13:16:38.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c92ffd640 1 --2- 172.21.15.120:0/3002050822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94135570 0x7f3c94137990 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf2c6daaff09f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c927fc640 1 -- 172.21.15.120:0/3002050822 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c88009d80 con 0x7f3c94135570 2024-09-18T13:16:38.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c927fc640 1 -- 172.21.15.120:0/3002050822 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c8800e230 con 0x7f3c94135570 2024-09-18T13:16:38.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.495+0000 7f3c927fc640 1 -- 172.21.15.120:0/3002050822 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c8800e4d0 con 0x7f3c94135570 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 1 -- 172.21.15.120:0/3002050822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94135570 msgr2=0x7f3c94137990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 1 --2- 172.21.15.120:0/3002050822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94135570 0x7f3c94137990 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 1 -- 172.21.15.120:0/3002050822 shutdown_connections 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 1 --2- 172.21.15.120:0/3002050822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94135570 0x7f3c94137990 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 1 -- 172.21.15.120:0/3002050822 >> 172.21.15.120:0/3002050822 conn(0x7f3c940a11f0 msgr2=0x7f3c940a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 1 -- 172.21.15.120:0/3002050822 shutdown_connections 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 1 -- 172.21.15.120:0/3002050822 wait complete. 2024-09-18T13:16:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.496+0000 7f3c99d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:38.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.497+0000 7f3c99d11640 1 Processor -- start 2024-09-18T13:16:38.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.498+0000 7f3c99d11640 1 -- start start 2024-09-18T13:16:38.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c99d11640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94132790 0x7f3c940740a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c99d11640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3c940716c0 con 0x7f3c94132790 2024-09-18T13:16:38.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94132790 0x7f3c940740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94132790 0x7f3c940740a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60384/0 (socket says 172.21.15.120:60384) 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c937fe640 1 -- 172.21.15.120:0/626025418 learned_addr learned my addr 172.21.15.120:0/626025418 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c937fe640 1 -- 172.21.15.120:0/626025418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c94071ca0 con 0x7f3c94132790 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c937fe640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94132790 0x7f3c940740a0 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c7bfff640 1 -- 172.21.15.120:0/626025418 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c840070b0 con 0x7f3c94132790 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c7bfff640 1 -- 172.21.15.120:0/626025418 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c84007210 con 0x7f3c94132790 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9409c8b0 con 0x7f3c94132790 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c7bfff640 1 -- 172.21.15.120:0/626025418 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c840074b0 con 0x7f3c94132790 2024-09-18T13:16:38.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.499+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c940738b0 con 0x7f3c94132790 2024-09-18T13:16:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.500+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c94132ba0 con 0x7f3c94132790 2024-09-18T13:16:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.500+0000 7f3c7bfff640 1 -- 172.21.15.120:0/626025418 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3c84007660 con 0x7f3c94132790 2024-09-18T13:16:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.501+0000 7f3c7bfff640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3c8003e930 0x7f3c80040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.501+0000 7f3c7bfff640 1 -- 172.21.15.120:0/626025418 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f3c84050290 con 0x7f3c94132790 2024-09-18T13:16:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.501+0000 7f3c92ffd640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3c8003e930 0x7f3c80040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.501+0000 7f3c92ffd640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3c8003e930 0x7f3c80040e40 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:38.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.506+0000 7f3c7bfff640 1 -- 172.21.15.120:0/626025418 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f3c840096b0 con 0x7f3c94132790 2024-09-18T13:16:38.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.676+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c94130e70 con 0x7f3c8003e930 2024-09-18T13:16:38.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.679+0000 7f3c7bfff640 1 -- 172.21.15.120:0/626025418 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109018 (crc 0 0 0) 0x7f3c94130e70 con 0x7f3c8003e930 2024-09-18T13:16:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T13:16:38.681 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T13:16:38.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3c8003e930 msgr2=0x7f3c80040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3c8003e930 0x7f3c80040e40 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94132790 msgr2=0x7f3c940740a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:38.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94132790 0x7f3c940740a0 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 shutdown_connections 2024-09-18T13:16:38.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f3c8003e930 0x7f3c80040e40 unknown :-1 s=CLOSED pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 --2- 172.21.15.120:0/626025418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c94132790 0x7f3c940740a0 unknown :-1 s=CLOSED pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:38.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 >> 172.21.15.120:0/626025418 conn(0x7f3c940a11f0 msgr2=0x7f3c94131380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:38.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 shutdown_connections 2024-09-18T13:16:38.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:38.681+0000 7f3c99d11640 1 -- 172.21.15.120:0/626025418 wait complete. 2024-09-18T13:16:38.694 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1285,"stamp":"2024-09-18T13:16:36.837189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":242208,"kb_used_data":14112,"kb_used_omap":0,"kb_used_meta":228032,"kb_avail":377245152,"statfs":{"total":386547056640,"available":386299035648,"internally_reserved":0,"allocated":14450688,"data_stored":7082822,"data_compressed":354470,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":233504768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001883"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552988+0000","last_change":"2024-09-18T13:02:43.599349+0000","last_active":"2024-09-18T13:16:01.552988+0000","last_peered":"2024-09-18T13:16:01.552988+0000","last_clean":"2024-09-18T13:16:01.552988+0000","last_became_active":"2024-09-18T13:02:43.590588+0000","last_became_peered":"2024-09-18T13:02:43.590588+0000","last_unstale":"2024-09-18T13:16:01.552988+0000","last_undegraded":"2024-09-18T13:16:01.552988+0000","last_fullsized":"2024-09-18T13:16:01.552988+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543414+0000","last_change":"2024-09-18T13:02:43.498337+0000","last_active":"2024-09-18T13:16:01.543414+0000","last_peered":"2024-09-18T13:16:01.543414+0000","last_clean":"2024-09-18T13:16:01.543414+0000","last_became_active":"2024-09-18T13:02:43.486897+0000","last_became_peered":"2024-09-18T13:02:43.486897+0000","last_unstale":"2024-09-18T13:16:01.543414+0000","last_undegraded":"2024-09-18T13:16:01.543414+0000","last_fullsized":"2024-09-18T13:16:01.543414+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550088+0000","last_change":"2024-09-18T13:02:43.540031+0000","last_active":"2024-09-18T13:16:01.550088+0000","last_peered":"2024-09-18T13:16:01.550088+0000","last_clean":"2024-09-18T13:16:01.550088+0000","last_became_active":"2024-09-18T13:02:43.532857+0000","last_became_peered":"2024-09-18T13:02:43.532857+0000","last_unstale":"2024-09-18T13:16:01.550088+0000","last_undegraded":"2024-09-18T13:16:01.550088+0000","last_fullsized":"2024-09-18T13:16:01.550088+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.540903+0000","last_change":"2024-09-18T13:02:43.533350+0000","last_active":"2024-09-18T13:16:01.540903+0000","last_peered":"2024-09-18T13:16:01.540903+0000","last_clean":"2024-09-18T13:16:01.540903+0000","last_became_active":"2024-09-18T13:02:43.511170+0000","last_became_peered":"2024-09-18T13:02:43.511170+0000","last_unstale":"2024-09-18T13:16:01.540903+0000","last_undegraded":"2024-09-18T13:16:01.540903+0000","last_fullsized":"2024-09-18T13:16:01.540903+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553782+0000","last_change":"2024-09-18T13:02:43.540161+0000","last_active":"2024-09-18T13:16:01.553782+0000","last_peered":"2024-09-18T13:16:01.553782+0000","last_clean":"2024-09-18T13:16:01.553782+0000","last_became_active":"2024-09-18T13:02:43.530098+0000","last_became_peered":"2024-09-18T13:02:43.530098+0000","last_unstale":"2024-09-18T13:16:01.553782+0000","last_undegraded":"2024-09-18T13:16:01.553782+0000","last_fullsized":"2024-09-18T13:16:01.553782+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556066+0000","last_change":"2024-09-18T13:02:43.596587+0000","last_active":"2024-09-18T13:16:01.556066+0000","last_peered":"2024-09-18T13:16:01.556066+0000","last_clean":"2024-09-18T13:16:01.556066+0000","last_became_active":"2024-09-18T13:02:43.586094+0000","last_became_peered":"2024-09-18T13:02:43.586094+0000","last_unstale":"2024-09-18T13:16:01.556066+0000","last_undegraded":"2024-09-18T13:16:01.556066+0000","last_fullsized":"2024-09-18T13:16:01.556066+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550582+0000","last_change":"2024-09-18T13:02:43.489572+0000","last_active":"2024-09-18T13:16:01.550582+0000","last_peered":"2024-09-18T13:16:01.550582+0000","last_clean":"2024-09-18T13:16:01.550582+0000","last_became_active":"2024-09-18T13:02:43.485079+0000","last_became_peered":"2024-09-18T13:02:43.485079+0000","last_unstale":"2024-09-18T13:16:01.550582+0000","last_undegraded":"2024-09-18T13:16:01.550582+0000","last_fullsized":"2024-09-18T13:16:01.550582+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.546093+0000","last_change":"2024-09-18T13:02:43.460695+0000","last_active":"2024-09-18T13:16:01.546093+0000","last_peered":"2024-09-18T13:16:01.546093+0000","last_clean":"2024-09-18T13:16:01.546093+0000","last_became_active":"2024-09-18T13:02:43.449840+0000","last_became_peered":"2024-09-18T13:02:43.449840+0000","last_unstale":"2024-09-18T13:16:01.546093+0000","last_undegraded":"2024-09-18T13:16:01.546093+0000","last_fullsized":"2024-09-18T13:16:01.546093+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552165+0000","last_change":"2024-09-18T13:02:43.561872+0000","last_active":"2024-09-18T13:16:01.552165+0000","last_peered":"2024-09-18T13:16:01.552165+0000","last_clean":"2024-09-18T13:16:01.552165+0000","last_became_active":"2024-09-18T13:02:43.556273+0000","last_became_peered":"2024-09-18T13:02:43.556273+0000","last_unstale":"2024-09-18T13:16:01.552165+0000","last_undegraded":"2024-09-18T13:16:01.552165+0000","last_fullsized":"2024-09-18T13:16:01.552165+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.561062+0000","last_change":"2024-09-18T13:02:43.570131+0000","last_active":"2024-09-18T13:16:01.561062+0000","last_peered":"2024-09-18T13:16:01.561062+0000","last_clean":"2024-09-18T13:16:01.561062+0000","last_became_active":"2024-09-18T13:02:43.560225+0000","last_became_peered":"2024-09-18T13:02:43.560225+0000","last_unstale":"2024-09-18T13:16:01.561062+0000","last_undegraded":"2024-09-18T13:16:01.561062+0000","last_fullsized":"2024-09-18T13:16:01.561062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551843+0000","last_change":"2024-09-18T13:02:43.436362+0000","last_active":"2024-09-18T13:16:01.551843+0000","last_peered":"2024-09-18T13:16:01.551843+0000","last_clean":"2024-09-18T13:16:01.551843+0000","last_became_active":"2024-09-18T13:02:43.423644+0000","last_became_peered":"2024-09-18T13:02:43.423644+0000","last_unstale":"2024-09-18T13:16:01.551843+0000","last_undegraded":"2024-09-18T13:16:01.551843+0000","last_fullsized":"2024-09-18T13:16:01.551843+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547337+0000","last_change":"2024-09-18T13:02:43.535591+0000","last_active":"2024-09-18T13:16:01.547337+0000","last_peered":"2024-09-18T13:16:01.547337+0000","last_clean":"2024-09-18T13:16:01.547337+0000","last_became_active":"2024-09-18T13:02:43.524825+0000","last_became_peered":"2024-09-18T13:02:43.524825+0000","last_unstale":"2024-09-18T13:16:01.547337+0000","last_undegraded":"2024-09-18T13:16:01.547337+0000","last_fullsized":"2024-09-18T13:16:01.547337+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.560376+0000","last_change":"2024-09-18T13:02:43.582811+0000","last_active":"2024-09-18T13:16:01.560376+0000","last_peered":"2024-09-18T13:16:01.560376+0000","last_clean":"2024-09-18T13:16:01.560376+0000","last_became_active":"2024-09-18T13:02:43.571390+0000","last_became_peered":"2024-09-18T13:02:43.571390+0000","last_unstale":"2024-09-18T13:16:01.560376+0000","last_undegraded":"2024-09-18T13:16:01.560376+0000","last_fullsized":"2024-09-18T13:16:01.560376+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.545464+0000","last_change":"2024-09-18T13:02:43.526115+0000","last_active":"2024-09-18T13:16:01.545464+0000","last_peered":"2024-09-18T13:16:01.545464+0000","last_clean":"2024-09-18T13:16:01.545464+0000","last_became_active":"2024-09-18T13:02:43.504340+0000","last_became_peered":"2024-09-18T13:02:43.504340+0000","last_unstale":"2024-09-18T13:16:01.545464+0000","last_undegraded":"2024-09-18T13:16:01.545464+0000","last_fullsized":"2024-09-18T13:16:01.545464+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558435+0000","last_change":"2024-09-18T13:02:43.576863+0000","last_active":"2024-09-18T13:16:01.558435+0000","last_peered":"2024-09-18T13:16:01.558435+0000","last_clean":"2024-09-18T13:16:01.558435+0000","last_became_active":"2024-09-18T13:02:43.568592+0000","last_became_peered":"2024-09-18T13:02:43.568592+0000","last_unstale":"2024-09-18T13:16:01.558435+0000","last_undegraded":"2024-09-18T13:16:01.558435+0000","last_fullsized":"2024-09-18T13:16:01.558435+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.541033+0000","last_change":"2024-09-18T13:02:43.498554+0000","last_active":"2024-09-18T13:16:01.541033+0000","last_peered":"2024-09-18T13:16:01.541033+0000","last_clean":"2024-09-18T13:16:01.541033+0000","last_became_active":"2024-09-18T13:02:43.492774+0000","last_became_peered":"2024-09-18T13:02:43.492774+0000","last_unstale":"2024-09-18T13:16:01.541033+0000","last_undegraded":"2024-09-18T13:16:01.541033+0000","last_fullsized":"2024-09-18T13:16:01.541033+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549649+0000","last_change":"2024-09-18T13:02:43.534935+0000","last_active":"2024-09-18T13:16:01.549649+0000","last_peered":"2024-09-18T13:16:01.549649+0000","last_clean":"2024-09-18T13:16:01.549649+0000","last_became_active":"2024-09-18T13:02:43.523232+0000","last_became_peered":"2024-09-18T13:02:43.523232+0000","last_unstale":"2024-09-18T13:16:01.549649+0000","last_undegraded":"2024-09-18T13:16:01.549649+0000","last_fullsized":"2024-09-18T13:16:01.549649+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551968+0000","last_change":"2024-09-18T13:02:43.576965+0000","last_active":"2024-09-18T13:16:01.551968+0000","last_peered":"2024-09-18T13:16:01.551968+0000","last_clean":"2024-09-18T13:16:01.551968+0000","last_became_active":"2024-09-18T13:02:43.565270+0000","last_became_peered":"2024-09-18T13:02:43.565270+0000","last_unstale":"2024-09-18T13:16:01.551968+0000","last_undegraded":"2024-09-18T13:16:01.551968+0000","last_fullsized":"2024-09-18T13:16:01.551968+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.539268+0000","last_change":"2024-09-18T13:02:43.489078+0000","last_active":"2024-09-18T13:16:01.539268+0000","last_peered":"2024-09-18T13:16:01.539268+0000","last_clean":"2024-09-18T13:16:01.539268+0000","last_became_active":"2024-09-18T13:02:43.475127+0000","last_became_peered":"2024-09-18T13:02:43.475127+0000","last_unstale":"2024-09-18T13:16:01.539268+0000","last_undegraded":"2024-09-18T13:16:01.539268+0000","last_fullsized":"2024-09-18T13:16:01.539268+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550254+0000","last_change":"2024-09-18T13:02:43.518460+0000","last_active":"2024-09-18T13:16:01.550254+0000","last_peered":"2024-09-18T13:16:01.550254+0000","last_clean":"2024-09-18T13:16:01.550254+0000","last_became_active":"2024-09-18T13:02:43.511706+0000","last_became_peered":"2024-09-18T13:02:43.511706+0000","last_unstale":"2024-09-18T13:16:01.550254+0000","last_undegraded":"2024-09-18T13:16:01.550254+0000","last_fullsized":"2024-09-18T13:16:01.550254+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557095+0000","last_change":"2024-09-18T13:02:43.547134+0000","last_active":"2024-09-18T13:16:01.557095+0000","last_peered":"2024-09-18T13:16:01.557095+0000","last_clean":"2024-09-18T13:16:01.557095+0000","last_became_active":"2024-09-18T13:02:43.540420+0000","last_became_peered":"2024-09-18T13:02:43.540420+0000","last_unstale":"2024-09-18T13:16:01.557095+0000","last_undegraded":"2024-09-18T13:16:01.557095+0000","last_fullsized":"2024-09-18T13:16:01.557095+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.548178+0000","last_change":"2024-09-18T13:02:43.513580+0000","last_active":"2024-09-18T13:16:01.548178+0000","last_peered":"2024-09-18T13:16:01.548178+0000","last_clean":"2024-09-18T13:16:01.548178+0000","last_became_active":"2024-09-18T13:02:43.506008+0000","last_became_peered":"2024-09-18T13:02:43.506008+0000","last_unstale":"2024-09-18T13:16:01.548178+0000","last_undegraded":"2024-09-18T13:16:01.548178+0000","last_fullsized":"2024-09-18T13:16:01.548178+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.558001+0000","last_change":"2024-09-18T13:02:43.551512+0000","last_active":"2024-09-18T13:16:01.558001+0000","last_peered":"2024-09-18T13:16:01.558001+0000","last_clean":"2024-09-18T13:16:01.558001+0000","last_became_active":"2024-09-18T13:02:43.544809+0000","last_became_peered":"2024-09-18T13:02:43.544809+0000","last_unstale":"2024-09-18T13:16:01.558001+0000","last_undegraded":"2024-09-18T13:16:01.558001+0000","last_fullsized":"2024-09-18T13:16:01.558001+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.553523+0000","last_change":"2024-09-18T13:02:43.552029+0000","last_active":"2024-09-18T13:16:01.553523+0000","last_peered":"2024-09-18T13:16:01.553523+0000","last_clean":"2024-09-18T13:16:01.553523+0000","last_became_active":"2024-09-18T13:02:43.532465+0000","last_became_peered":"2024-09-18T13:02:43.532465+0000","last_unstale":"2024-09-18T13:16:01.553523+0000","last_undegraded":"2024-09-18T13:16:01.553523+0000","last_fullsized":"2024-09-18T13:16:01.553523+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.557180+0000","last_change":"2024-09-18T13:02:43.548538+0000","last_active":"2024-09-18T13:16:01.557180+0000","last_peered":"2024-09-18T13:16:01.557180+0000","last_clean":"2024-09-18T13:16:01.557180+0000","last_became_active":"2024-09-18T13:02:43.540114+0000","last_became_peered":"2024-09-18T13:02:43.540114+0000","last_unstale":"2024-09-18T13:16:01.557180+0000","last_undegraded":"2024-09-18T13:16:01.557180+0000","last_fullsized":"2024-09-18T13:16:01.557180+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.556568+0000","last_change":"2024-09-18T13:02:43.528988+0000","last_active":"2024-09-18T13:16:01.556568+0000","last_peered":"2024-09-18T13:16:01.556568+0000","last_clean":"2024-09-18T13:16:01.556568+0000","last_became_active":"2024-09-18T13:02:43.519357+0000","last_became_peered":"2024-09-18T13:02:43.519357+0000","last_unstale":"2024-09-18T13:16:01.556568+0000","last_undegraded":"2024-09-18T13:16:01.556568+0000","last_fullsized":"2024-09-18T13:16:01.556568+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.547849+0000","last_change":"2024-09-18T13:02:43.540324+0000","last_active":"2024-09-18T13:16:01.547849+0000","last_peered":"2024-09-18T13:16:01.547849+0000","last_clean":"2024-09-18T13:16:01.547849+0000","last_became_active":"2024-09-18T13:02:43.517545+0000","last_became_peered":"2024-09-18T13:02:43.517545+0000","last_unstale":"2024-09-18T13:16:01.547849+0000","last_undegraded":"2024-09-18T13:16:01.547849+0000","last_fullsized":"2024-09-18T13:16:01.547849+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549190+0000","last_change":"2024-09-18T13:02:43.479354+0000","last_active":"2024-09-18T13:16:01.549190+0000","last_peered":"2024-09-18T13:16:01.549190+0000","last_clean":"2024-09-18T13:16:01.549190+0000","last_became_active":"2024-09-18T13:02:43.467457+0000","last_became_peered":"2024-09-18T13:02:43.467457+0000","last_unstale":"2024-09-18T13:16:01.549190+0000","last_undegraded":"2024-09-18T13:16:01.549190+0000","last_fullsized":"2024-09-18T13:16:01.549190+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.549054+0000","last_change":"2024-09-18T13:02:43.593763+0000","last_active":"2024-09-18T13:16:01.549054+0000","last_peered":"2024-09-18T13:16:01.549054+0000","last_clean":"2024-09-18T13:16:01.549054+0000","last_became_active":"2024-09-18T13:02:43.582192+0000","last_became_peered":"2024-09-18T13:02:43.582192+0000","last_unstale":"2024-09-18T13:16:01.549054+0000","last_undegraded":"2024-09-18T13:16:01.549054+0000","last_fullsized":"2024-09-18T13:16:01.549054+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.551277+0000","last_change":"2024-09-18T13:02:43.562670+0000","last_active":"2024-09-18T13:16:01.551277+0000","last_peered":"2024-09-18T13:16:01.551277+0000","last_clean":"2024-09-18T13:16:01.551277+0000","last_became_active":"2024-09-18T13:02:43.550918+0000","last_became_peered":"2024-09-18T13:02:43.550918+0000","last_unstale":"2024-09-18T13:16:01.551277+0000","last_undegraded":"2024-09-18T13:16:01.551277+0000","last_fullsized":"2024-09-18T13:16:01.551277+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1467,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555073+0000","last_change":"2024-09-18T13:02:43.574240+0000","last_active":"2024-09-18T13:16:01.555073+0000","last_peered":"2024-09-18T13:16:01.555073+0000","last_clean":"2024-09-18T13:16:01.555073+0000","last_became_active":"2024-09-18T13:02:43.562324+0000","last_became_peered":"2024-09-18T13:02:43.562324+0000","last_unstale":"2024-09-18T13:16:01.555073+0000","last_undegraded":"2024-09-18T13:16:01.555073+0000","last_fullsized":"2024-09-18T13:16:01.555073+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.562621+0000","last_change":"2024-09-18T13:02:43.573284+0000","last_active":"2024-09-18T13:16:01.562621+0000","last_peered":"2024-09-18T13:16:01.562621+0000","last_clean":"2024-09-18T13:16:01.562621+0000","last_became_active":"2024-09-18T13:02:43.564846+0000","last_became_peered":"2024-09-18T13:02:43.564846+0000","last_unstale":"2024-09-18T13:16:01.562621+0000","last_undegraded":"2024-09-18T13:16:01.562621+0000","last_fullsized":"2024-09-18T13:16:01.562621+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544929+0000","last_change":"2024-09-18T12:57:44.682637+0000","last_active":"2024-09-18T13:16:01.544929+0000","last_peered":"2024-09-18T13:16:01.544929+0000","last_clean":"2024-09-18T13:16:01.544929+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T13:16:01.544929+0000","last_undegraded":"2024-09-18T13:16:01.544929+0000","last_fullsized":"2024-09-18T13:16:01.544929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555327+0000","last_change":"2024-09-18T12:57:44.684106+0000","last_active":"2024-09-18T13:16:01.555327+0000","last_peered":"2024-09-18T13:16:01.555327+0000","last_clean":"2024-09-18T13:16:01.555327+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T13:16:01.555327+0000","last_undegraded":"2024-09-18T13:16:01.555327+0000","last_fullsized":"2024-09-18T13:16:01.555327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.538460+0000","last_change":"2024-09-18T12:57:44.680252+0000","last_active":"2024-09-18T13:16:01.538460+0000","last_peered":"2024-09-18T13:16:01.538460+0000","last_clean":"2024-09-18T13:16:01.538460+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T13:16:01.538460+0000","last_undegraded":"2024-09-18T13:16:01.538460+0000","last_fullsized":"2024-09-18T13:16:01.538460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552778+0000","last_change":"2024-09-18T12:57:44.684632+0000","last_active":"2024-09-18T13:16:01.552778+0000","last_peered":"2024-09-18T13:16:01.552778+0000","last_clean":"2024-09-18T13:16:01.552778+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T13:16:01.552778+0000","last_undegraded":"2024-09-18T13:16:01.552778+0000","last_fullsized":"2024-09-18T13:16:01.552778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":2132,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.550279+0000","last_change":"2024-09-18T12:57:44.684900+0000","last_active":"2024-09-18T13:16:01.550279+0000","last_peered":"2024-09-18T13:16:01.550279+0000","last_clean":"2024-09-18T13:16:01.550279+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T13:16:01.550279+0000","last_undegraded":"2024-09-18T13:16:01.550279+0000","last_fullsized":"2024-09-18T13:16:01.550279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.552368+0000","last_change":"2024-09-18T12:57:44.684570+0000","last_active":"2024-09-18T13:16:01.552368+0000","last_peered":"2024-09-18T13:16:01.552368+0000","last_clean":"2024-09-18T13:16:01.552368+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T13:16:01.552368+0000","last_undegraded":"2024-09-18T13:16:01.552368+0000","last_fullsized":"2024-09-18T13:16:01.552368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.543981+0000","last_change":"2024-09-18T12:57:44.682925+0000","last_active":"2024-09-18T13:16:01.543981+0000","last_peered":"2024-09-18T13:16:01.543981+0000","last_clean":"2024-09-18T13:16:01.543981+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T13:16:01.543981+0000","last_undegraded":"2024-09-18T13:16:01.543981+0000","last_fullsized":"2024-09-18T13:16:01.543981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":2131,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.555285+0000","last_change":"2024-09-18T12:57:44.685288+0000","last_active":"2024-09-18T13:16:01.555285+0000","last_peered":"2024-09-18T13:16:01.555285+0000","last_clean":"2024-09-18T13:16:01.555285+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T13:16:01.555285+0000","last_undegraded":"2024-09-18T13:16:01.555285+0000","last_fullsized":"2024-09-18T13:16:01.555285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2205,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-09-18T13:16:01.544207+0000","last_change":"2024-09-18T12:57:39.686575+0000","last_active":"2024-09-18T13:16:01.544207+0000","last_peered":"2024-09-18T13:16:01.544207+0000","last_clean":"2024-09-18T13:16:01.544207+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T13:16:01.544207+0000","last_undegraded":"2024-09-18T13:16:01.544207+0000","last_fullsized":"2024-09-18T13:16:01.544207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:38.643767+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48364,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94323476,"statfs":{"total":96636764160,"available":96587239424,"internally_reserved":0,"allocated":3567616,"data_stored":1456221,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66512,"kb_used_data":3584,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305328,"statfs":{"total":96636764160,"available":96568655872,"internally_reserved":0,"allocated":3670016,"data_stored":2098065,"data_compressed":118355,"data_compressed_allocated":163840,"data_compressed_original":757760,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66480,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305360,"statfs":{"total":96636764160,"available":96568688640,"internally_reserved":0,"allocated":3637248,"data_stored":2059459,"data_compressed":100691,"data_compressed_allocated":139264,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60852,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310988,"statfs":{"total":96636764160,"available":96574451712,"internally_reserved":0,"allocated":3575808,"data_stored":1469077,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:16:38.699 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.699 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.699 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.699 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.699 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.699 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.700 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.701 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.702 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.703 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.704 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T12:57:38.643767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=38, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:38.704 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T13:16:58.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:16:58.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.821+0000 7f2eebb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:58.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.826+0000 7f2eebb91640 1 Processor -- start 2024-09-18T13:16:58.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.826+0000 7f2eebb91640 1 -- start start 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.826+0000 7f2eebb91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2ee4138fd0 0x7f2ee413b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.826+0000 7f2eebb91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee4136c10 con 0x7f2ee41360f0 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.826+0000 7f2eebb91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee40a6010 con 0x7f2ee4138fd0 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee912c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2ee4138fd0 0x7f2ee413b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee992d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2ee41360f0 0x7f2ee4136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:43568/0 (socket says 172.21.15.120:43568) 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee992d640 1 -- 172.21.15.120:0/1499449737 learned_addr learned my addr 172.21.15.120:0/1499449737 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee912c640 1 -- 172.21.15.120:0/1499449737 >> v1:172.21.15.120:6789/0 conn(0x7f2ee41360f0 legacy=0x7f2ee4136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:58.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee912c640 1 -- 172.21.15.120:0/1499449737 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee40a5c40 con 0x7f2ee4138fd0 2024-09-18T13:16:58.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee892b640 1 -- 172.21.15.120:0/1499449737 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188310101 0 0) 0x7f2ee0001110 con 0x7f2ee41360f0 2024-09-18T13:16:58.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee912c640 1 --2- 172.21.15.120:0/1499449737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee4138fd0 0x7f2ee413b3f0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6eaa3905191eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:58.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee892b640 1 -- 172.21.15.120:0/1499449737 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ed4009d90 con 0x7f2ee4138fd0 2024-09-18T13:16:58.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee892b640 1 -- 172.21.15.120:0/1499449737 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2ed400e230 con 0x7f2ee4138fd0 2024-09-18T13:16:58.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.827+0000 7f2ee892b640 1 -- 172.21.15.120:0/1499449737 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ed400e4d0 con 0x7f2ee4138fd0 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 1 -- 172.21.15.120:0/1499449737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee4138fd0 msgr2=0x7f2ee413b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 1 --2- 172.21.15.120:0/1499449737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee4138fd0 0x7f2ee413b3f0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 1 -- 172.21.15.120:0/1499449737 shutdown_connections 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 1 --2- 172.21.15.120:0/1499449737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee4138fd0 0x7f2ee413b3f0 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 1 -- 172.21.15.120:0/1499449737 >> 172.21.15.120:0/1499449737 conn(0x7f2ee406f850 msgr2=0x7f2ee409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 1 -- 172.21.15.120:0/1499449737 shutdown_connections 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 1 -- 172.21.15.120:0/1499449737 wait complete. 2024-09-18T13:16:58.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.829+0000 7f2eebb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:16:58.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.830+0000 7f2eebb91640 1 Processor -- start 2024-09-18T13:16:58.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.830+0000 7f2eebb91640 1 -- start start 2024-09-18T13:16:58.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2eebb91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee41360f0 0x7f2ee4134800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:58.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2eebb91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee4121bc0 con 0x7f2ee41360f0 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2ee992d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee41360f0 0x7f2ee4134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2ee992d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee41360f0 0x7f2ee4134800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44820/0 (socket says 172.21.15.120:44820) 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2ee992d640 1 -- 172.21.15.120:0/134579203 learned_addr learned my addr 172.21.15.120:0/134579203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2ee992d640 1 -- 172.21.15.120:0/134579203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee4134e90 con 0x7f2ee41360f0 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2ee992d640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee41360f0 0x7f2ee4134800 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2eda7fc640 1 -- 172.21.15.120:0/134579203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ee0004b80 con 0x7f2ee41360f0 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2eda7fc640 1 -- 172.21.15.120:0/134579203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2ee0004ce0 con 0x7f2ee41360f0 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee41247e0 con 0x7f2ee41360f0 2024-09-18T13:16:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2eda7fc640 1 -- 172.21.15.120:0/134579203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ee0007120 con 0x7f2ee41360f0 2024-09-18T13:16:58.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.831+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee4123c90 con 0x7f2ee41360f0 2024-09-18T13:16:58.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.832+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee40a10f0 con 0x7f2ee41360f0 2024-09-18T13:16:58.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.833+0000 7f2eda7fc640 1 -- 172.21.15.120:0/134579203 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2ee00072d0 con 0x7f2ee41360f0 2024-09-18T13:16:58.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.833+0000 7f2eda7fc640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2ec803e930 0x7f2ec8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:58.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.833+0000 7f2eda7fc640 1 -- 172.21.15.120:0/134579203 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f2ee004f940 con 0x7f2ee41360f0 2024-09-18T13:16:58.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.833+0000 7f2ee912c640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2ec803e930 0x7f2ec8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:58.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.834+0000 7f2ee912c640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2ec803e930 0x7f2ec8040e40 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:58.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:58.839+0000 7f2eda7fc640 1 -- 172.21.15.120:0/134579203 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f2ee000a890 con 0x7f2ee41360f0 2024-09-18T13:16:59.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.009+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ee406fec0 con 0x7f2ec803e930 2024-09-18T13:16:59.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.013+0000 7f2eda7fc640 1 -- 172.21.15.120:0/134579203 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+108974 (crc 0 0 0) 0x7f2ed400e4c0 con 0x7f2ec803e930 2024-09-18T13:16:59.016 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T13:16:59.017 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2ec803e930 msgr2=0x7f2ec8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2ec803e930 0x7f2ec8040e40 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee41360f0 msgr2=0x7f2ee4134800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee41360f0 0x7f2ee4134800 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 shutdown_connections 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f2ec803e930 0x7f2ec8040e40 unknown :-1 s=CLOSED pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 --2- 172.21.15.120:0/134579203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ee41360f0 0x7f2ee4134800 unknown :-1 s=CLOSED pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 >> 172.21.15.120:0/134579203 conn(0x7f2ee406f850 msgr2=0x7f2ee41be0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 shutdown_connections 2024-09-18T13:16:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:16:59.015+0000 7f2eebb91640 1 -- 172.21.15.120:0/134579203 wait complete. 2024-09-18T13:16:59.028 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1296,"stamp":"2024-09-18T13:16:58.843241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":245864,"kb_used_data":13608,"kb_used_omap":0,"kb_used_meta":232192,"kb_avail":377241496,"statfs":{"total":386547056640,"available":386295291904,"internally_reserved":0,"allocated":13934592,"data_stored":6472744,"data_compressed":60070,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":237764608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003354"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.553224+0000","last_change":"2024-09-18T13:02:43.599349+0000","last_active":"2024-09-18T13:16:33.553224+0000","last_peered":"2024-09-18T13:16:33.553224+0000","last_clean":"2024-09-18T13:16:33.553224+0000","last_became_active":"2024-09-18T13:02:43.590588+0000","last_became_peered":"2024-09-18T13:02:43.590588+0000","last_unstale":"2024-09-18T13:16:33.553224+0000","last_undegraded":"2024-09-18T13:16:33.553224+0000","last_fullsized":"2024-09-18T13:16:33.553224+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.550431+0000","last_change":"2024-09-18T13:02:43.498337+0000","last_active":"2024-09-18T13:16:33.550431+0000","last_peered":"2024-09-18T13:16:33.550431+0000","last_clean":"2024-09-18T13:16:33.550431+0000","last_became_active":"2024-09-18T13:02:43.486897+0000","last_became_peered":"2024-09-18T13:02:43.486897+0000","last_unstale":"2024-09-18T13:16:33.550431+0000","last_undegraded":"2024-09-18T13:16:33.550431+0000","last_fullsized":"2024-09-18T13:16:33.550431+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.454456+0000","last_change":"2024-09-18T13:16:37.484838+0000","last_active":"2024-09-18T13:16:37.454456+0000","last_peered":"2024-09-18T13:16:37.454456+0000","last_clean":"2024-09-18T13:16:37.454456+0000","last_became_active":"2024-09-18T13:02:43.532857+0000","last_became_peered":"2024-09-18T13:02:43.532857+0000","last_unstale":"2024-09-18T13:16:37.454456+0000","last_undegraded":"2024-09-18T13:16:37.454456+0000","last_fullsized":"2024-09-18T13:16:37.454456+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.484558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.484558+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.451969+0000","last_change":"2024-09-18T13:16:37.482963+0000","last_active":"2024-09-18T13:16:37.451969+0000","last_peered":"2024-09-18T13:16:37.451969+0000","last_clean":"2024-09-18T13:16:37.451969+0000","last_became_active":"2024-09-18T13:02:43.511170+0000","last_became_peered":"2024-09-18T13:02:43.511170+0000","last_unstale":"2024-09-18T13:16:37.451969+0000","last_undegraded":"2024-09-18T13:16:37.451969+0000","last_fullsized":"2024-09-18T13:16:37.451969+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.482779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.482779+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.555670+0000","last_change":"2024-09-18T13:02:43.540161+0000","last_active":"2024-09-18T13:16:33.555670+0000","last_peered":"2024-09-18T13:16:33.555670+0000","last_clean":"2024-09-18T13:16:33.555670+0000","last_became_active":"2024-09-18T13:02:43.530098+0000","last_became_peered":"2024-09-18T13:02:43.530098+0000","last_unstale":"2024-09-18T13:16:33.555670+0000","last_undegraded":"2024-09-18T13:16:33.555670+0000","last_fullsized":"2024-09-18T13:16:33.555670+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.559105+0000","last_change":"2024-09-18T13:02:43.596587+0000","last_active":"2024-09-18T13:16:33.559105+0000","last_peered":"2024-09-18T13:16:33.559105+0000","last_clean":"2024-09-18T13:16:33.559105+0000","last_became_active":"2024-09-18T13:02:43.586094+0000","last_became_peered":"2024-09-18T13:02:43.586094+0000","last_unstale":"2024-09-18T13:16:33.559105+0000","last_undegraded":"2024-09-18T13:16:33.559105+0000","last_fullsized":"2024-09-18T13:16:33.559105+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.550302+0000","last_change":"2024-09-18T13:02:43.489572+0000","last_active":"2024-09-18T13:16:33.550302+0000","last_peered":"2024-09-18T13:16:33.550302+0000","last_clean":"2024-09-18T13:16:33.550302+0000","last_became_active":"2024-09-18T13:02:43.485079+0000","last_became_peered":"2024-09-18T13:02:43.485079+0000","last_unstale":"2024-09-18T13:16:33.550302+0000","last_undegraded":"2024-09-18T13:16:33.550302+0000","last_fullsized":"2024-09-18T13:16:33.550302+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.541636+0000","last_change":"2024-09-18T13:02:43.460695+0000","last_active":"2024-09-18T13:16:33.541636+0000","last_peered":"2024-09-18T13:16:33.541636+0000","last_clean":"2024-09-18T13:16:33.541636+0000","last_became_active":"2024-09-18T13:02:43.449840+0000","last_became_peered":"2024-09-18T13:02:43.449840+0000","last_unstale":"2024-09-18T13:16:33.541636+0000","last_undegraded":"2024-09-18T13:16:33.541636+0000","last_fullsized":"2024-09-18T13:16:33.541636+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.447724+0000","last_change":"2024-09-18T13:16:37.483468+0000","last_active":"2024-09-18T13:16:37.447724+0000","last_peered":"2024-09-18T13:16:37.447724+0000","last_clean":"2024-09-18T13:16:37.447724+0000","last_became_active":"2024-09-18T13:02:43.556273+0000","last_became_peered":"2024-09-18T13:02:43.556273+0000","last_unstale":"2024-09-18T13:16:37.447724+0000","last_undegraded":"2024-09-18T13:16:37.447724+0000","last_fullsized":"2024-09-18T13:16:37.447724+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.483296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.483296+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.982958+0000","last_change":"2024-09-18T13:16:36.998152+0000","last_active":"2024-09-18T13:16:36.982958+0000","last_peered":"2024-09-18T13:16:36.982958+0000","last_clean":"2024-09-18T13:16:36.982958+0000","last_became_active":"2024-09-18T13:02:43.560225+0000","last_became_peered":"2024-09-18T13:02:43.560225+0000","last_unstale":"2024-09-18T13:16:36.982958+0000","last_undegraded":"2024-09-18T13:16:36.982958+0000","last_fullsized":"2024-09-18T13:16:36.982958+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.997956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.997956+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.980507+0000","last_change":"2024-09-18T13:16:36.995402+0000","last_active":"2024-09-18T13:16:36.980507+0000","last_peered":"2024-09-18T13:16:36.980507+0000","last_clean":"2024-09-18T13:16:36.980507+0000","last_became_active":"2024-09-18T13:02:43.423644+0000","last_became_peered":"2024-09-18T13:02:43.423644+0000","last_unstale":"2024-09-18T13:16:36.980507+0000","last_undegraded":"2024-09-18T13:16:36.980507+0000","last_fullsized":"2024-09-18T13:16:36.980507+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.995115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.995115+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.560783+0000","last_change":"2024-09-18T13:02:43.535591+0000","last_active":"2024-09-18T13:16:33.560783+0000","last_peered":"2024-09-18T13:16:33.560783+0000","last_clean":"2024-09-18T13:16:33.560783+0000","last_became_active":"2024-09-18T13:02:43.524825+0000","last_became_peered":"2024-09-18T13:02:43.524825+0000","last_unstale":"2024-09-18T13:16:33.560783+0000","last_undegraded":"2024-09-18T13:16:33.560783+0000","last_fullsized":"2024-09-18T13:16:33.560783+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.448313+0000","last_change":"2024-09-18T13:16:37.468424+0000","last_active":"2024-09-18T13:16:37.448313+0000","last_peered":"2024-09-18T13:16:37.448313+0000","last_clean":"2024-09-18T13:16:37.448313+0000","last_became_active":"2024-09-18T13:02:43.571390+0000","last_became_peered":"2024-09-18T13:02:43.571390+0000","last_unstale":"2024-09-18T13:16:37.448313+0000","last_undegraded":"2024-09-18T13:16:37.448313+0000","last_fullsized":"2024-09-18T13:16:37.448313+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.468151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.468151+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.445923+0000","last_change":"2024-09-18T13:16:37.472074+0000","last_active":"2024-09-18T13:16:37.445923+0000","last_peered":"2024-09-18T13:16:37.445923+0000","last_clean":"2024-09-18T13:16:37.445923+0000","last_became_active":"2024-09-18T13:02:43.504340+0000","last_became_peered":"2024-09-18T13:02:43.504340+0000","last_unstale":"2024-09-18T13:16:37.445923+0000","last_undegraded":"2024-09-18T13:16:37.445923+0000","last_fullsized":"2024-09-18T13:16:37.445923+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.471910+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.548193+0000","last_change":"2024-09-18T13:02:43.576863+0000","last_active":"2024-09-18T13:16:33.548193+0000","last_peered":"2024-09-18T13:16:33.548193+0000","last_clean":"2024-09-18T13:16:33.548193+0000","last_became_active":"2024-09-18T13:02:43.568592+0000","last_became_peered":"2024-09-18T13:02:43.568592+0000","last_unstale":"2024-09-18T13:16:33.548193+0000","last_undegraded":"2024-09-18T13:16:33.548193+0000","last_fullsized":"2024-09-18T13:16:33.548193+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.532451+0000","last_change":"2024-09-18T13:02:43.498554+0000","last_active":"2024-09-18T13:16:33.532451+0000","last_peered":"2024-09-18T13:16:33.532451+0000","last_clean":"2024-09-18T13:16:33.532451+0000","last_became_active":"2024-09-18T13:02:43.492774+0000","last_became_peered":"2024-09-18T13:02:43.492774+0000","last_unstale":"2024-09-18T13:16:33.532451+0000","last_undegraded":"2024-09-18T13:16:33.532451+0000","last_fullsized":"2024-09-18T13:16:33.532451+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.542369+0000","last_change":"2024-09-18T13:02:43.534935+0000","last_active":"2024-09-18T13:16:33.542369+0000","last_peered":"2024-09-18T13:16:33.542369+0000","last_clean":"2024-09-18T13:16:33.542369+0000","last_became_active":"2024-09-18T13:02:43.523232+0000","last_became_peered":"2024-09-18T13:02:43.523232+0000","last_unstale":"2024-09-18T13:16:33.542369+0000","last_undegraded":"2024-09-18T13:16:33.542369+0000","last_fullsized":"2024-09-18T13:16:33.542369+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.444560+0000","last_change":"2024-09-18T13:16:37.478134+0000","last_active":"2024-09-18T13:16:37.444560+0000","last_peered":"2024-09-18T13:16:37.444560+0000","last_clean":"2024-09-18T13:16:37.444560+0000","last_became_active":"2024-09-18T13:02:43.565270+0000","last_became_peered":"2024-09-18T13:02:43.565270+0000","last_unstale":"2024-09-18T13:16:37.444560+0000","last_undegraded":"2024-09-18T13:16:37.444560+0000","last_fullsized":"2024-09-18T13:16:37.444560+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.477963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.477963+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.442424+0000","last_change":"2024-09-18T13:16:37.469986+0000","last_active":"2024-09-18T13:16:37.442424+0000","last_peered":"2024-09-18T13:16:37.442424+0000","last_clean":"2024-09-18T13:16:37.442424+0000","last_became_active":"2024-09-18T13:02:43.475127+0000","last_became_peered":"2024-09-18T13:02:43.475127+0000","last_unstale":"2024-09-18T13:16:37.442424+0000","last_undegraded":"2024-09-18T13:16:37.442424+0000","last_fullsized":"2024-09-18T13:16:37.442424+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.469816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.469816+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.552772+0000","last_change":"2024-09-18T13:02:43.518460+0000","last_active":"2024-09-18T13:16:33.552772+0000","last_peered":"2024-09-18T13:16:33.552772+0000","last_clean":"2024-09-18T13:16:33.552772+0000","last_became_active":"2024-09-18T13:02:43.511706+0000","last_became_peered":"2024-09-18T13:02:43.511706+0000","last_unstale":"2024-09-18T13:16:33.552772+0000","last_undegraded":"2024-09-18T13:16:33.552772+0000","last_fullsized":"2024-09-18T13:16:33.552772+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.556427+0000","last_change":"2024-09-18T13:02:43.547134+0000","last_active":"2024-09-18T13:16:33.556427+0000","last_peered":"2024-09-18T13:16:33.556427+0000","last_clean":"2024-09-18T13:16:33.556427+0000","last_became_active":"2024-09-18T13:02:43.540420+0000","last_became_peered":"2024-09-18T13:02:43.540420+0000","last_unstale":"2024-09-18T13:16:33.556427+0000","last_undegraded":"2024-09-18T13:16:33.556427+0000","last_fullsized":"2024-09-18T13:16:33.556427+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.549686+0000","last_change":"2024-09-18T13:02:43.513580+0000","last_active":"2024-09-18T13:16:33.549686+0000","last_peered":"2024-09-18T13:16:33.549686+0000","last_clean":"2024-09-18T13:16:33.549686+0000","last_became_active":"2024-09-18T13:02:43.506008+0000","last_became_peered":"2024-09-18T13:02:43.506008+0000","last_unstale":"2024-09-18T13:16:33.549686+0000","last_undegraded":"2024-09-18T13:16:33.549686+0000","last_fullsized":"2024-09-18T13:16:33.549686+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.980047+0000","last_change":"2024-09-18T13:16:36.999568+0000","last_active":"2024-09-18T13:16:36.980047+0000","last_peered":"2024-09-18T13:16:36.980047+0000","last_clean":"2024-09-18T13:16:36.980047+0000","last_became_active":"2024-09-18T13:02:43.544809+0000","last_became_peered":"2024-09-18T13:02:43.544809+0000","last_unstale":"2024-09-18T13:16:36.980047+0000","last_undegraded":"2024-09-18T13:16:36.980047+0000","last_fullsized":"2024-09-18T13:16:36.980047+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.999402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.999402+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.978702+0000","last_change":"2024-09-18T13:16:36.993975+0000","last_active":"2024-09-18T13:16:36.978702+0000","last_peered":"2024-09-18T13:16:36.978702+0000","last_clean":"2024-09-18T13:16:36.978702+0000","last_became_active":"2024-09-18T13:02:43.532465+0000","last_became_peered":"2024-09-18T13:02:43.532465+0000","last_unstale":"2024-09-18T13:16:36.978702+0000","last_undegraded":"2024-09-18T13:16:36.978702+0000","last_fullsized":"2024-09-18T13:16:36.978702+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.993695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.993695+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.978620+0000","last_change":"2024-09-18T13:16:36.998579+0000","last_active":"2024-09-18T13:16:36.978620+0000","last_peered":"2024-09-18T13:16:36.978620+0000","last_clean":"2024-09-18T13:16:36.978620+0000","last_became_active":"2024-09-18T13:02:43.540114+0000","last_became_peered":"2024-09-18T13:02:43.540114+0000","last_unstale":"2024-09-18T13:16:36.978620+0000","last_undegraded":"2024-09-18T13:16:36.978620+0000","last_fullsized":"2024-09-18T13:16:36.978620+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.998415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.998415+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.554330+0000","last_change":"2024-09-18T13:02:43.528988+0000","last_active":"2024-09-18T13:16:33.554330+0000","last_peered":"2024-09-18T13:16:33.554330+0000","last_clean":"2024-09-18T13:16:33.554330+0000","last_became_active":"2024-09-18T13:02:43.519357+0000","last_became_peered":"2024-09-18T13:02:43.519357+0000","last_unstale":"2024-09-18T13:16:33.554330+0000","last_undegraded":"2024-09-18T13:16:33.554330+0000","last_fullsized":"2024-09-18T13:16:33.554330+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.977064+0000","last_change":"2024-09-18T13:16:36.989870+0000","last_active":"2024-09-18T13:16:36.977064+0000","last_peered":"2024-09-18T13:16:36.977064+0000","last_clean":"2024-09-18T13:16:36.977064+0000","last_became_active":"2024-09-18T13:02:43.517545+0000","last_became_peered":"2024-09-18T13:02:43.517545+0000","last_unstale":"2024-09-18T13:16:36.977064+0000","last_undegraded":"2024-09-18T13:16:36.977064+0000","last_fullsized":"2024-09-18T13:16:36.977064+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.989686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.989686+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.537300+0000","last_change":"2024-09-18T13:02:43.479354+0000","last_active":"2024-09-18T13:16:33.537300+0000","last_peered":"2024-09-18T13:16:33.537300+0000","last_clean":"2024-09-18T13:16:33.537300+0000","last_became_active":"2024-09-18T13:02:43.467457+0000","last_became_peered":"2024-09-18T13:02:43.467457+0000","last_unstale":"2024-09-18T13:16:33.537300+0000","last_undegraded":"2024-09-18T13:16:33.537300+0000","last_fullsized":"2024-09-18T13:16:33.537300+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.560042+0000","last_change":"2024-09-18T13:02:43.593763+0000","last_active":"2024-09-18T13:16:33.560042+0000","last_peered":"2024-09-18T13:16:33.560042+0000","last_clean":"2024-09-18T13:16:33.560042+0000","last_became_active":"2024-09-18T13:02:43.582192+0000","last_became_peered":"2024-09-18T13:02:43.582192+0000","last_unstale":"2024-09-18T13:16:33.560042+0000","last_undegraded":"2024-09-18T13:16:33.560042+0000","last_fullsized":"2024-09-18T13:16:33.560042+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1460,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.552641+0000","last_change":"2024-09-18T13:02:43.562670+0000","last_active":"2024-09-18T13:16:33.552641+0000","last_peered":"2024-09-18T13:16:33.552641+0000","last_clean":"2024-09-18T13:16:33.552641+0000","last_became_active":"2024-09-18T13:02:43.550918+0000","last_became_peered":"2024-09-18T13:02:43.550918+0000","last_unstale":"2024-09-18T13:16:33.552641+0000","last_undegraded":"2024-09-18T13:16:33.552641+0000","last_fullsized":"2024-09-18T13:16:33.552641+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1473,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.561073+0000","last_change":"2024-09-18T13:02:43.574240+0000","last_active":"2024-09-18T13:16:33.561073+0000","last_peered":"2024-09-18T13:16:33.561073+0000","last_clean":"2024-09-18T13:16:33.561073+0000","last_became_active":"2024-09-18T13:02:43.562324+0000","last_became_peered":"2024-09-18T13:02:43.562324+0000","last_unstale":"2024-09-18T13:16:33.561073+0000","last_undegraded":"2024-09-18T13:16:33.561073+0000","last_fullsized":"2024-09-18T13:16:33.561073+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:02:42.363759+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.978615+0000","last_change":"2024-09-18T13:16:36.992735+0000","last_active":"2024-09-18T13:16:36.978615+0000","last_peered":"2024-09-18T13:16:36.978615+0000","last_clean":"2024-09-18T13:16:36.978615+0000","last_became_active":"2024-09-18T13:02:43.564846+0000","last_became_peered":"2024-09-18T13:02:43.564846+0000","last_unstale":"2024-09-18T13:16:36.978615+0000","last_undegraded":"2024-09-18T13:16:36.978615+0000","last_fullsized":"2024-09-18T13:16:36.978615+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.992465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.992465+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.540932+0000","last_change":"2024-09-18T12:57:44.682637+0000","last_active":"2024-09-18T13:16:33.540932+0000","last_peered":"2024-09-18T13:16:33.540932+0000","last_clean":"2024-09-18T13:16:33.540932+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T13:16:33.540932+0000","last_undegraded":"2024-09-18T13:16:33.540932+0000","last_fullsized":"2024-09-18T13:16:33.540932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.443113+0000","last_change":"2024-09-18T13:16:37.476316+0000","last_active":"2024-09-18T13:16:37.443113+0000","last_peered":"2024-09-18T13:16:37.443113+0000","last_clean":"2024-09-18T13:16:37.443113+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T13:16:37.443113+0000","last_undegraded":"2024-09-18T13:16:37.443113+0000","last_fullsized":"2024-09-18T13:16:37.443113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.476005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.476005+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.441309+0000","last_change":"2024-09-18T13:16:37.466139+0000","last_active":"2024-09-18T13:16:37.441309+0000","last_peered":"2024-09-18T13:16:37.441309+0000","last_clean":"2024-09-18T13:16:37.441309+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T13:16:37.441309+0000","last_undegraded":"2024-09-18T13:16:37.441309+0000","last_fullsized":"2024-09-18T13:16:37.441309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.465971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.465971+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.441929+0000","last_change":"2024-09-18T13:16:37.480133+0000","last_active":"2024-09-18T13:16:37.441929+0000","last_peered":"2024-09-18T13:16:37.441929+0000","last_clean":"2024-09-18T13:16:37.441929+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T13:16:37.441929+0000","last_undegraded":"2024-09-18T13:16:37.441929+0000","last_fullsized":"2024-09-18T13:16:37.441929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.479961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.479961+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.549638+0000","last_change":"2024-09-18T12:57:44.684900+0000","last_active":"2024-09-18T13:16:33.549638+0000","last_peered":"2024-09-18T13:16:33.549638+0000","last_clean":"2024-09-18T13:16:33.549638+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T13:16:33.549638+0000","last_undegraded":"2024-09-18T13:16:33.549638+0000","last_fullsized":"2024-09-18T13:16:33.549638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.566447+0000","last_change":"2024-09-18T12:57:44.684570+0000","last_active":"2024-09-18T13:16:33.566447+0000","last_peered":"2024-09-18T13:16:33.566447+0000","last_clean":"2024-09-18T13:16:33.566447+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T13:16:33.566447+0000","last_undegraded":"2024-09-18T13:16:33.566447+0000","last_fullsized":"2024-09-18T13:16:33.566447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.551043+0000","last_change":"2024-09-18T12:57:44.682925+0000","last_active":"2024-09-18T13:16:33.551043+0000","last_peered":"2024-09-18T13:16:33.551043+0000","last_clean":"2024-09-18T13:16:33.551043+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T13:16:33.551043+0000","last_undegraded":"2024-09-18T13:16:33.551043+0000","last_fullsized":"2024-09-18T13:16:33.551043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":2137,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:33.551399+0000","last_change":"2024-09-18T12:57:44.685288+0000","last_active":"2024-09-18T13:16:33.551399+0000","last_peered":"2024-09-18T13:16:33.551399+0000","last_clean":"2024-09-18T13:16:33.551399+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T13:16:33.551399+0000","last_undegraded":"2024-09-18T13:16:33.551399+0000","last_fullsized":"2024-09-18T13:16:33.551399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:57:41.649750+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2213,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.439536+0000","last_change":"2024-09-18T13:16:37.480521+0000","last_active":"2024-09-18T13:16:37.439536+0000","last_peered":"2024-09-18T13:16:37.439536+0000","last_clean":"2024-09-18T13:16:37.439536+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T13:16:37.439536+0000","last_undegraded":"2024-09-18T13:16:37.439536+0000","last_fullsized":"2024-09-18T13:16:37.439536+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-18T13:16:37.480334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.480334+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48256,"kb_used_data":3376,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94323584,"statfs":{"total":96636764160,"available":96587350016,"internally_reserved":0,"allocated":3457024,"data_stored":1323014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66356,"kb_used_data":3428,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305484,"statfs":{"total":96636764160,"available":96568815616,"internally_reserved":0,"allocated":3510272,"data_stored":1913358,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70520,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301320,"statfs":{"total":96636764160,"available":96564551680,"internally_reserved":0,"allocated":3514368,"data_stored":1913377,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60732,"kb_used_data":3372,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311108,"statfs":{"total":96636764160,"available":96574574592,"internally_reserved":0,"allocated":3452928,"data_stored":1322995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:16:59.030 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.030 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.031 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.032 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.032 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.032 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.032 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.032 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.032 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.033 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.033 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-18T13:02:42.363759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=2, tm_sec=42, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.033 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.033 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.033 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.034 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.034 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T12:57:41.649750+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=57, tm_sec=41, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=13, tm_min=16, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T13:16:59.034 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T13:17:19.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T13:17:19.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.152+0000 7f44dc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:17:19.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.157+0000 7f44dc391640 1 Processor -- start 2024-09-18T13:17:19.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.157+0000 7f44dc391640 1 -- start start 2024-09-18T13:17:19.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.158+0000 7f44dc391640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f44d41360f0 0x7f44d4136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:17:19.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.158+0000 7f44dc391640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d40a5c40 con 0x7f44d409e170 2024-09-18T13:17:19.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.158+0000 7f44dc391640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f44d40a6010 con 0x7f44d41360f0 2024-09-18T13:17:19.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.158+0000 7f44da12d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f44d41360f0 0x7f44d4136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:17:19.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.158+0000 7f44d992c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f44d409e170 0x7f44d409e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33456/0 (socket says 172.21.15.120:33456) 2024-09-18T13:17:19.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.158+0000 7f44d992c640 1 -- 172.21.15.120:0/1802094387 learned_addr learned my addr 172.21.15.120:0/1802094387 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:17:19.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.159+0000 7f44da12d640 1 -- 172.21.15.120:0/1802094387 >> v1:172.21.15.120:6789/0 conn(0x7f44d409e170 legacy=0x7f44d409e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.159+0000 7f44da12d640 1 -- 172.21.15.120:0/1802094387 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d409f510 con 0x7f44d41360f0 2024-09-18T13:17:19.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.159+0000 7f44d912b640 1 -- 172.21.15.120:0/1802094387 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403588668 0 0) 0x7f44d40a5c40 con 0x7f44d409e170 2024-09-18T13:17:19.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.159+0000 7f44da12d640 1 --2- 172.21.15.120:0/1802094387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d41360f0 0x7f44d4136500 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756494f8e7503ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:17:19.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.159+0000 7f44d912b640 1 -- 172.21.15.120:0/1802094387 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44cc009d90 con 0x7f44d41360f0 2024-09-18T13:17:19.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.159+0000 7f44d912b640 1 -- 172.21.15.120:0/1802094387 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f44cc00e230 con 0x7f44d41360f0 2024-09-18T13:17:19.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.159+0000 7f44d912b640 1 -- 172.21.15.120:0/1802094387 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44cc00e4d0 con 0x7f44d41360f0 2024-09-18T13:17:19.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 1 -- 172.21.15.120:0/1802094387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d41360f0 msgr2=0x7f44d4136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 1 --2- 172.21.15.120:0/1802094387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d41360f0 0x7f44d4136500 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 1 -- 172.21.15.120:0/1802094387 shutdown_connections 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 1 --2- 172.21.15.120:0/1802094387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d41360f0 0x7f44d4136500 unknown :-1 s=CLOSED pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 1 -- 172.21.15.120:0/1802094387 >> 172.21.15.120:0/1802094387 conn(0x7f44d406f850 msgr2=0x7f44d409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 1 -- 172.21.15.120:0/1802094387 shutdown_connections 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 1 -- 172.21.15.120:0/1802094387 wait complete. 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.160+0000 7f44dc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.161+0000 7f44dc391640 1 Processor -- start 2024-09-18T13:17:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.161+0000 7f44dc391640 1 -- start start 2024-09-18T13:17:19.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.162+0000 7f44dc391640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d409e170 0x7f44d4120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.162+0000 7f44dc391640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4124ba0 con 0x7f44d409e170 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44da12d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d409e170 0x7f44d4120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44da12d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d409e170 0x7f44d4120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46138/0 (socket says 172.21.15.120:46138) 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44da12d640 1 -- 172.21.15.120:0/3491290103 learned_addr learned my addr 172.21.15.120:0/3491290103 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44da12d640 1 -- 172.21.15.120:0/3491290103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d4124810 con 0x7f44d409e170 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44da12d640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d409e170 0x7f44d4120b70 crc :-1 s=READY pgs=13016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44d2ffd640 1 -- 172.21.15.120:0/3491290103 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44cc013530 con 0x7f44d409e170 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44d2ffd640 1 -- 172.21.15.120:0/3491290103 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f44cc013690 con 0x7f44d409e170 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d4121ff0 con 0x7f44d409e170 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44d2ffd640 1 -- 172.21.15.120:0/3491290103 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44cc013930 con 0x7f44d409e170 2024-09-18T13:17:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.163+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d4124500 con 0x7f44d409e170 2024-09-18T13:17:19.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.164+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d40008d0 con 0x7f44d409e170 2024-09-18T13:17:19.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.164+0000 7f44d2ffd640 1 -- 172.21.15.120:0/3491290103 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f44cc013ae0 con 0x7f44d409e170 2024-09-18T13:17:19.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.164+0000 7f44d2ffd640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f44c003e930 0x7f44c0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:17:19.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.165+0000 7f44d2ffd640 1 -- 172.21.15.120:0/3491290103 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f44cc018040 con 0x7f44d409e170 2024-09-18T13:17:19.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.165+0000 7f44d992c640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f44c003e930 0x7f44c0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:17:19.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.165+0000 7f44d992c640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f44c003e930 0x7f44c0040e40 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:17:19.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.170+0000 7f44d2ffd640 1 -- 172.21.15.120:0/3491290103 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f44cc017190 con 0x7f44d409e170 2024-09-18T13:17:19.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.341+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 --> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44d406fec0 con 0x7f44c003e930 2024-09-18T13:17:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.344+0000 7f44d2ffd640 1 -- 172.21.15.120:0/3491290103 <== mgr.4100 v2:172.21.15.176:6800/3363408531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+108978 (crc 0 0 0) 0x7f44c8001d70 con 0x7f44c003e930 2024-09-18T13:17:19.346 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-18T13:17:19.346 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f44c003e930 msgr2=0x7f44c0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f44c003e930 0x7f44c0040e40 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d409e170 msgr2=0x7f44d4120b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d409e170 0x7f44d4120b70 crc :-1 s=READY pgs=13016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 shutdown_connections 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f44c003e930 0x7f44c0040e40 unknown :-1 s=CLOSED pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 --2- 172.21.15.120:0/3491290103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d409e170 0x7f44d4120b70 unknown :-1 s=CLOSED pgs=13016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 >> 172.21.15.120:0/3491290103 conn(0x7f44d406f850 msgr2=0x7f44d41bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 shutdown_connections 2024-09-18T13:17:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.346+0000 7f44dc391640 1 -- 172.21.15.120:0/3491290103 wait complete. 2024-09-18T13:17:19.358 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1306,"stamp":"2024-09-18T13:17:18.848317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":245864,"kb_used_data":13608,"kb_used_omap":0,"kb_used_meta":232192,"kb_avail":377241496,"statfs":{"total":386547056640,"available":386295291904,"internally_reserved":0,"allocated":13934592,"data_stored":6472744,"data_compressed":60070,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":237764608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003084"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.409946+0000","last_change":"2024-09-18T13:16:38.432660+0000","last_active":"2024-09-18T13:16:38.409946+0000","last_peered":"2024-09-18T13:16:38.409946+0000","last_clean":"2024-09-18T13:16:38.409946+0000","last_became_active":"2024-09-18T13:02:43.590588+0000","last_became_peered":"2024-09-18T13:02:43.590588+0000","last_unstale":"2024-09-18T13:16:38.409946+0000","last_undegraded":"2024-09-18T13:16:38.409946+0000","last_fullsized":"2024-09-18T13:16:38.409946+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.432364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.432364+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.410618+0000","last_change":"2024-09-18T13:16:38.433270+0000","last_active":"2024-09-18T13:16:38.410618+0000","last_peered":"2024-09-18T13:16:38.410618+0000","last_clean":"2024-09-18T13:16:38.410618+0000","last_became_active":"2024-09-18T13:02:43.486897+0000","last_became_peered":"2024-09-18T13:02:43.486897+0000","last_unstale":"2024-09-18T13:16:38.410618+0000","last_undegraded":"2024-09-18T13:16:38.410618+0000","last_fullsized":"2024-09-18T13:16:38.410618+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.433087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.433087+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.454456+0000","last_change":"2024-09-18T13:16:37.484838+0000","last_active":"2024-09-18T13:16:37.454456+0000","last_peered":"2024-09-18T13:16:37.454456+0000","last_clean":"2024-09-18T13:16:37.454456+0000","last_became_active":"2024-09-18T13:02:43.532857+0000","last_became_peered":"2024-09-18T13:02:43.532857+0000","last_unstale":"2024-09-18T13:16:37.454456+0000","last_undegraded":"2024-09-18T13:16:37.454456+0000","last_fullsized":"2024-09-18T13:16:37.454456+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.484558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.484558+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.451969+0000","last_change":"2024-09-18T13:16:37.482963+0000","last_active":"2024-09-18T13:16:37.451969+0000","last_peered":"2024-09-18T13:16:37.451969+0000","last_clean":"2024-09-18T13:16:37.451969+0000","last_became_active":"2024-09-18T13:02:43.511170+0000","last_became_peered":"2024-09-18T13:02:43.511170+0000","last_unstale":"2024-09-18T13:16:37.451969+0000","last_undegraded":"2024-09-18T13:16:37.451969+0000","last_fullsized":"2024-09-18T13:16:37.451969+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.482779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.482779+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.406092+0000","last_change":"2024-09-18T13:16:38.440887+0000","last_active":"2024-09-18T13:16:38.406092+0000","last_peered":"2024-09-18T13:16:38.406092+0000","last_clean":"2024-09-18T13:16:38.406092+0000","last_became_active":"2024-09-18T13:02:43.530098+0000","last_became_peered":"2024-09-18T13:02:43.530098+0000","last_unstale":"2024-09-18T13:16:38.406092+0000","last_undegraded":"2024-09-18T13:16:38.406092+0000","last_fullsized":"2024-09-18T13:16:38.406092+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.440723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.440723+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.405105+0000","last_change":"2024-09-18T13:16:38.430455+0000","last_active":"2024-09-18T13:16:38.405105+0000","last_peered":"2024-09-18T13:16:38.405105+0000","last_clean":"2024-09-18T13:16:38.405105+0000","last_became_active":"2024-09-18T13:02:43.586094+0000","last_became_peered":"2024-09-18T13:02:43.586094+0000","last_unstale":"2024-09-18T13:16:38.405105+0000","last_undegraded":"2024-09-18T13:16:38.405105+0000","last_fullsized":"2024-09-18T13:16:38.405105+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.430268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.430268+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.912057+0000","last_change":"2024-09-18T13:16:37.920644+0000","last_active":"2024-09-18T13:16:37.912057+0000","last_peered":"2024-09-18T13:16:37.912057+0000","last_clean":"2024-09-18T13:16:37.912057+0000","last_became_active":"2024-09-18T13:02:43.485079+0000","last_became_peered":"2024-09-18T13:02:43.485079+0000","last_unstale":"2024-09-18T13:16:37.912057+0000","last_undegraded":"2024-09-18T13:16:37.912057+0000","last_fullsized":"2024-09-18T13:16:37.912057+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.920441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.920441+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.402930+0000","last_change":"2024-09-18T13:16:38.437742+0000","last_active":"2024-09-18T13:16:38.402930+0000","last_peered":"2024-09-18T13:16:38.402930+0000","last_clean":"2024-09-18T13:16:38.402930+0000","last_became_active":"2024-09-18T13:02:43.449840+0000","last_became_peered":"2024-09-18T13:02:43.449840+0000","last_unstale":"2024-09-18T13:16:38.402930+0000","last_undegraded":"2024-09-18T13:16:38.402930+0000","last_fullsized":"2024-09-18T13:16:38.402930+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.437548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.437548+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.447724+0000","last_change":"2024-09-18T13:16:37.483468+0000","last_active":"2024-09-18T13:16:37.447724+0000","last_peered":"2024-09-18T13:16:37.447724+0000","last_clean":"2024-09-18T13:16:37.447724+0000","last_became_active":"2024-09-18T13:02:43.556273+0000","last_became_peered":"2024-09-18T13:02:43.556273+0000","last_unstale":"2024-09-18T13:16:37.447724+0000","last_undegraded":"2024-09-18T13:16:37.447724+0000","last_fullsized":"2024-09-18T13:16:37.447724+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.483296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.483296+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.982958+0000","last_change":"2024-09-18T13:16:36.998152+0000","last_active":"2024-09-18T13:16:36.982958+0000","last_peered":"2024-09-18T13:16:36.982958+0000","last_clean":"2024-09-18T13:16:36.982958+0000","last_became_active":"2024-09-18T13:02:43.560225+0000","last_became_peered":"2024-09-18T13:02:43.560225+0000","last_unstale":"2024-09-18T13:16:36.982958+0000","last_undegraded":"2024-09-18T13:16:36.982958+0000","last_fullsized":"2024-09-18T13:16:36.982958+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.997956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.997956+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.980507+0000","last_change":"2024-09-18T13:16:36.995402+0000","last_active":"2024-09-18T13:16:36.980507+0000","last_peered":"2024-09-18T13:16:36.980507+0000","last_clean":"2024-09-18T13:16:36.980507+0000","last_became_active":"2024-09-18T13:02:43.423644+0000","last_became_peered":"2024-09-18T13:02:43.423644+0000","last_unstale":"2024-09-18T13:16:36.980507+0000","last_undegraded":"2024-09-18T13:16:36.980507+0000","last_fullsized":"2024-09-18T13:16:36.980507+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.995115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.995115+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.401374+0000","last_change":"2024-09-18T13:16:38.431229+0000","last_active":"2024-09-18T13:16:38.401374+0000","last_peered":"2024-09-18T13:16:38.401374+0000","last_clean":"2024-09-18T13:16:38.401374+0000","last_became_active":"2024-09-18T13:02:43.524825+0000","last_became_peered":"2024-09-18T13:02:43.524825+0000","last_unstale":"2024-09-18T13:16:38.401374+0000","last_undegraded":"2024-09-18T13:16:38.401374+0000","last_fullsized":"2024-09-18T13:16:38.401374+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.431053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.431053+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.448313+0000","last_change":"2024-09-18T13:16:37.468424+0000","last_active":"2024-09-18T13:16:37.448313+0000","last_peered":"2024-09-18T13:16:37.448313+0000","last_clean":"2024-09-18T13:16:37.448313+0000","last_became_active":"2024-09-18T13:02:43.571390+0000","last_became_peered":"2024-09-18T13:02:43.571390+0000","last_unstale":"2024-09-18T13:16:37.448313+0000","last_undegraded":"2024-09-18T13:16:37.448313+0000","last_fullsized":"2024-09-18T13:16:37.448313+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.468151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.468151+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.445923+0000","last_change":"2024-09-18T13:16:37.472074+0000","last_active":"2024-09-18T13:16:37.445923+0000","last_peered":"2024-09-18T13:16:37.445923+0000","last_clean":"2024-09-18T13:16:37.445923+0000","last_became_active":"2024-09-18T13:02:43.504340+0000","last_became_peered":"2024-09-18T13:02:43.504340+0000","last_unstale":"2024-09-18T13:16:37.445923+0000","last_undegraded":"2024-09-18T13:16:37.445923+0000","last_fullsized":"2024-09-18T13:16:37.445923+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.471910+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.399607+0000","last_change":"2024-09-18T13:16:38.429280+0000","last_active":"2024-09-18T13:16:38.399607+0000","last_peered":"2024-09-18T13:16:38.399607+0000","last_clean":"2024-09-18T13:16:38.399607+0000","last_became_active":"2024-09-18T13:02:43.568592+0000","last_became_peered":"2024-09-18T13:02:43.568592+0000","last_unstale":"2024-09-18T13:16:38.399607+0000","last_undegraded":"2024-09-18T13:16:38.399607+0000","last_fullsized":"2024-09-18T13:16:38.399607+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.429102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.429102+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.910575+0000","last_change":"2024-09-18T13:16:37.919687+0000","last_active":"2024-09-18T13:16:37.910575+0000","last_peered":"2024-09-18T13:16:37.910575+0000","last_clean":"2024-09-18T13:16:37.910575+0000","last_became_active":"2024-09-18T13:02:43.492774+0000","last_became_peered":"2024-09-18T13:02:43.492774+0000","last_unstale":"2024-09-18T13:16:37.910575+0000","last_undegraded":"2024-09-18T13:16:37.910575+0000","last_fullsized":"2024-09-18T13:16:37.910575+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.919466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.919466+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.398548+0000","last_change":"2024-09-18T13:16:38.438989+0000","last_active":"2024-09-18T13:16:38.398548+0000","last_peered":"2024-09-18T13:16:38.398548+0000","last_clean":"2024-09-18T13:16:38.398548+0000","last_became_active":"2024-09-18T13:02:43.523232+0000","last_became_peered":"2024-09-18T13:02:43.523232+0000","last_unstale":"2024-09-18T13:16:38.398548+0000","last_undegraded":"2024-09-18T13:16:38.398548+0000","last_fullsized":"2024-09-18T13:16:38.398548+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.438803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.438803+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.444560+0000","last_change":"2024-09-18T13:16:37.478134+0000","last_active":"2024-09-18T13:16:37.444560+0000","last_peered":"2024-09-18T13:16:37.444560+0000","last_clean":"2024-09-18T13:16:37.444560+0000","last_became_active":"2024-09-18T13:02:43.565270+0000","last_became_peered":"2024-09-18T13:02:43.565270+0000","last_unstale":"2024-09-18T13:16:37.444560+0000","last_undegraded":"2024-09-18T13:16:37.444560+0000","last_fullsized":"2024-09-18T13:16:37.444560+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.477963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.477963+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.442424+0000","last_change":"2024-09-18T13:16:37.469986+0000","last_active":"2024-09-18T13:16:37.442424+0000","last_peered":"2024-09-18T13:16:37.442424+0000","last_clean":"2024-09-18T13:16:37.442424+0000","last_became_active":"2024-09-18T13:02:43.475127+0000","last_became_peered":"2024-09-18T13:02:43.475127+0000","last_unstale":"2024-09-18T13:16:37.442424+0000","last_undegraded":"2024-09-18T13:16:37.442424+0000","last_fullsized":"2024-09-18T13:16:37.442424+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.469816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.469816+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.395228+0000","last_change":"2024-09-18T13:16:38.437053+0000","last_active":"2024-09-18T13:16:38.395228+0000","last_peered":"2024-09-18T13:16:38.395228+0000","last_clean":"2024-09-18T13:16:38.395228+0000","last_became_active":"2024-09-18T13:02:43.511706+0000","last_became_peered":"2024-09-18T13:02:43.511706+0000","last_unstale":"2024-09-18T13:16:38.395228+0000","last_undegraded":"2024-09-18T13:16:38.395228+0000","last_fullsized":"2024-09-18T13:16:38.395228+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.436772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.436772+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.391216+0000","last_change":"2024-09-18T13:16:38.433645+0000","last_active":"2024-09-18T13:16:38.391216+0000","last_peered":"2024-09-18T13:16:38.391216+0000","last_clean":"2024-09-18T13:16:38.391216+0000","last_became_active":"2024-09-18T13:02:43.540420+0000","last_became_peered":"2024-09-18T13:02:43.540420+0000","last_unstale":"2024-09-18T13:16:38.391216+0000","last_undegraded":"2024-09-18T13:16:38.391216+0000","last_fullsized":"2024-09-18T13:16:38.391216+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.433481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.433481+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.390433+0000","last_change":"2024-09-18T13:16:38.434887+0000","last_active":"2024-09-18T13:16:38.390433+0000","last_peered":"2024-09-18T13:16:38.390433+0000","last_clean":"2024-09-18T13:16:38.390433+0000","last_became_active":"2024-09-18T13:02:43.506008+0000","last_became_peered":"2024-09-18T13:02:43.506008+0000","last_unstale":"2024-09-18T13:16:38.390433+0000","last_undegraded":"2024-09-18T13:16:38.390433+0000","last_fullsized":"2024-09-18T13:16:38.390433+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.434713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.434713+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.980047+0000","last_change":"2024-09-18T13:16:36.999568+0000","last_active":"2024-09-18T13:16:36.980047+0000","last_peered":"2024-09-18T13:16:36.980047+0000","last_clean":"2024-09-18T13:16:36.980047+0000","last_became_active":"2024-09-18T13:02:43.544809+0000","last_became_peered":"2024-09-18T13:02:43.544809+0000","last_unstale":"2024-09-18T13:16:36.980047+0000","last_undegraded":"2024-09-18T13:16:36.980047+0000","last_fullsized":"2024-09-18T13:16:36.980047+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.999402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.999402+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.978702+0000","last_change":"2024-09-18T13:16:36.993975+0000","last_active":"2024-09-18T13:16:36.978702+0000","last_peered":"2024-09-18T13:16:36.978702+0000","last_clean":"2024-09-18T13:16:36.978702+0000","last_became_active":"2024-09-18T13:02:43.532465+0000","last_became_peered":"2024-09-18T13:02:43.532465+0000","last_unstale":"2024-09-18T13:16:36.978702+0000","last_undegraded":"2024-09-18T13:16:36.978702+0000","last_fullsized":"2024-09-18T13:16:36.978702+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.993695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.993695+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.978620+0000","last_change":"2024-09-18T13:16:36.998579+0000","last_active":"2024-09-18T13:16:36.978620+0000","last_peered":"2024-09-18T13:16:36.978620+0000","last_clean":"2024-09-18T13:16:36.978620+0000","last_became_active":"2024-09-18T13:02:43.540114+0000","last_became_peered":"2024-09-18T13:02:43.540114+0000","last_unstale":"2024-09-18T13:16:36.978620+0000","last_undegraded":"2024-09-18T13:16:36.978620+0000","last_fullsized":"2024-09-18T13:16:36.978620+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.998415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.998415+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.385727+0000","last_change":"2024-09-18T13:16:38.431480+0000","last_active":"2024-09-18T13:16:38.385727+0000","last_peered":"2024-09-18T13:16:38.385727+0000","last_clean":"2024-09-18T13:16:38.385727+0000","last_became_active":"2024-09-18T13:02:43.519357+0000","last_became_peered":"2024-09-18T13:02:43.519357+0000","last_unstale":"2024-09-18T13:16:38.385727+0000","last_undegraded":"2024-09-18T13:16:38.385727+0000","last_fullsized":"2024-09-18T13:16:38.385727+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.431309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.431309+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.977064+0000","last_change":"2024-09-18T13:16:36.989870+0000","last_active":"2024-09-18T13:16:36.977064+0000","last_peered":"2024-09-18T13:16:36.977064+0000","last_clean":"2024-09-18T13:16:36.977064+0000","last_became_active":"2024-09-18T13:02:43.517545+0000","last_became_peered":"2024-09-18T13:02:43.517545+0000","last_unstale":"2024-09-18T13:16:36.977064+0000","last_undegraded":"2024-09-18T13:16:36.977064+0000","last_fullsized":"2024-09-18T13:16:36.977064+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.989686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.989686+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.379345+0000","last_change":"2024-09-18T13:16:38.426131+0000","last_active":"2024-09-18T13:16:38.379345+0000","last_peered":"2024-09-18T13:16:38.379345+0000","last_clean":"2024-09-18T13:16:38.379345+0000","last_became_active":"2024-09-18T13:02:43.467457+0000","last_became_peered":"2024-09-18T13:02:43.467457+0000","last_unstale":"2024-09-18T13:16:38.379345+0000","last_undegraded":"2024-09-18T13:16:38.379345+0000","last_fullsized":"2024-09-18T13:16:38.379345+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.425942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.425942+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.379495+0000","last_change":"2024-09-18T13:16:38.421147+0000","last_active":"2024-09-18T13:16:38.379495+0000","last_peered":"2024-09-18T13:16:38.379495+0000","last_clean":"2024-09-18T13:16:38.379495+0000","last_became_active":"2024-09-18T13:02:43.582192+0000","last_became_peered":"2024-09-18T13:02:43.582192+0000","last_unstale":"2024-09-18T13:16:38.379495+0000","last_undegraded":"2024-09-18T13:16:38.379495+0000","last_fullsized":"2024-09-18T13:16:38.379495+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.420834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.420834+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.376303+0000","last_change":"2024-09-18T13:16:38.423258+0000","last_active":"2024-09-18T13:16:38.376303+0000","last_peered":"2024-09-18T13:16:38.376303+0000","last_clean":"2024-09-18T13:16:38.376303+0000","last_became_active":"2024-09-18T13:02:43.550918+0000","last_became_peered":"2024-09-18T13:02:43.550918+0000","last_unstale":"2024-09-18T13:16:38.376303+0000","last_undegraded":"2024-09-18T13:16:38.376303+0000","last_fullsized":"2024-09-18T13:16:38.376303+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.423079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.423079+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1475,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.375829+0000","last_change":"2024-09-18T13:16:38.417577+0000","last_active":"2024-09-18T13:16:38.375829+0000","last_peered":"2024-09-18T13:16:38.375829+0000","last_clean":"2024-09-18T13:16:38.375829+0000","last_became_active":"2024-09-18T13:02:43.562324+0000","last_became_peered":"2024-09-18T13:02:43.562324+0000","last_unstale":"2024-09-18T13:16:38.375829+0000","last_undegraded":"2024-09-18T13:16:38.375829+0000","last_fullsized":"2024-09-18T13:16:38.375829+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"239'7","last_scrub_stamp":"2024-09-18T13:16:38.417255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.417255+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:36.978615+0000","last_change":"2024-09-18T13:16:36.992735+0000","last_active":"2024-09-18T13:16:36.978615+0000","last_peered":"2024-09-18T13:16:36.978615+0000","last_clean":"2024-09-18T13:16:36.978615+0000","last_became_active":"2024-09-18T13:02:43.564846+0000","last_became_peered":"2024-09-18T13:02:43.564846+0000","last_unstale":"2024-09-18T13:16:36.978615+0000","last_undegraded":"2024-09-18T13:16:36.978615+0000","last_fullsized":"2024-09-18T13:16:36.978615+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:36.992465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:36.992465+0000","last_clean_scrub_stamp":"2024-09-18T13:02:42.363759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.371868+0000","last_change":"2024-09-18T13:16:38.427003+0000","last_active":"2024-09-18T13:16:38.371868+0000","last_peered":"2024-09-18T13:16:38.371868+0000","last_clean":"2024-09-18T13:16:38.371868+0000","last_became_active":"2024-09-18T12:57:42.711682+0000","last_became_peered":"2024-09-18T12:57:42.711682+0000","last_unstale":"2024-09-18T13:16:38.371868+0000","last_undegraded":"2024-09-18T13:16:38.371868+0000","last_fullsized":"2024-09-18T13:16:38.371868+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.426800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.426800+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.443113+0000","last_change":"2024-09-18T13:16:37.476316+0000","last_active":"2024-09-18T13:16:37.443113+0000","last_peered":"2024-09-18T13:16:37.443113+0000","last_clean":"2024-09-18T13:16:37.443113+0000","last_became_active":"2024-09-18T12:57:42.719163+0000","last_became_peered":"2024-09-18T12:57:42.719163+0000","last_unstale":"2024-09-18T13:16:37.443113+0000","last_undegraded":"2024-09-18T13:16:37.443113+0000","last_fullsized":"2024-09-18T13:16:37.443113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.476005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.476005+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.441309+0000","last_change":"2024-09-18T13:16:37.466139+0000","last_active":"2024-09-18T13:16:37.441309+0000","last_peered":"2024-09-18T13:16:37.441309+0000","last_clean":"2024-09-18T13:16:37.441309+0000","last_became_active":"2024-09-18T12:57:42.699174+0000","last_became_peered":"2024-09-18T12:57:42.699174+0000","last_unstale":"2024-09-18T13:16:37.441309+0000","last_undegraded":"2024-09-18T13:16:37.441309+0000","last_fullsized":"2024-09-18T13:16:37.441309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.465971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.465971+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.441929+0000","last_change":"2024-09-18T13:16:37.480133+0000","last_active":"2024-09-18T13:16:37.441929+0000","last_peered":"2024-09-18T13:16:37.441929+0000","last_clean":"2024-09-18T13:16:37.441929+0000","last_became_active":"2024-09-18T12:57:42.714139+0000","last_became_peered":"2024-09-18T12:57:42.714139+0000","last_unstale":"2024-09-18T13:16:37.441929+0000","last_undegraded":"2024-09-18T13:16:37.441929+0000","last_fullsized":"2024-09-18T13:16:37.441929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.479961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.479961+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":2140,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.372181+0000","last_change":"2024-09-18T13:16:38.425444+0000","last_active":"2024-09-18T13:16:38.372181+0000","last_peered":"2024-09-18T13:16:38.372181+0000","last_clean":"2024-09-18T13:16:38.372181+0000","last_became_active":"2024-09-18T12:57:42.740378+0000","last_became_peered":"2024-09-18T12:57:42.740378+0000","last_unstale":"2024-09-18T13:16:38.372181+0000","last_undegraded":"2024-09-18T13:16:38.372181+0000","last_fullsized":"2024-09-18T13:16:38.372181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2024-09-18T13:16:38.425107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.425107+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.910783+0000","last_change":"2024-09-18T13:16:37.921791+0000","last_active":"2024-09-18T13:16:37.910783+0000","last_peered":"2024-09-18T13:16:37.910783+0000","last_clean":"2024-09-18T13:16:37.910783+0000","last_became_active":"2024-09-18T12:57:42.719103+0000","last_became_peered":"2024-09-18T12:57:42.719103+0000","last_unstale":"2024-09-18T13:16:37.910783+0000","last_undegraded":"2024-09-18T13:16:37.910783+0000","last_fullsized":"2024-09-18T13:16:37.910783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:37.921591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.921591+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2138,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.369433+0000","last_change":"2024-09-18T13:16:38.417421+0000","last_active":"2024-09-18T13:16:38.369433+0000","last_peered":"2024-09-18T13:16:38.369433+0000","last_clean":"2024-09-18T13:16:38.369433+0000","last_became_active":"2024-09-18T12:57:42.724435+0000","last_became_peered":"2024-09-18T12:57:42.724435+0000","last_unstale":"2024-09-18T13:16:38.369433+0000","last_undegraded":"2024-09-18T13:16:38.369433+0000","last_fullsized":"2024-09-18T13:16:38.369433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T13:16:38.417139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.417139+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":2139,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:38.372171+0000","last_change":"2024-09-18T13:16:38.421968+0000","last_active":"2024-09-18T13:16:38.372171+0000","last_peered":"2024-09-18T13:16:38.372171+0000","last_clean":"2024-09-18T13:16:38.372171+0000","last_became_active":"2024-09-18T12:57:42.733942+0000","last_became_peered":"2024-09-18T12:57:42.733942+0000","last_unstale":"2024-09-18T13:16:38.372171+0000","last_undegraded":"2024-09-18T13:16:38.372171+0000","last_fullsized":"2024-09-18T13:16:38.372171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-09-18T13:16:38.421766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:38.421766+0000","last_clean_scrub_stamp":"2024-09-18T12:57:41.649750+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2213,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-18T13:16:37.439536+0000","last_change":"2024-09-18T13:16:37.480521+0000","last_active":"2024-09-18T13:16:37.439536+0000","last_peered":"2024-09-18T13:16:37.439536+0000","last_clean":"2024-09-18T13:16:37.439536+0000","last_became_active":"2024-09-18T12:57:39.678267+0000","last_became_peered":"2024-09-18T12:57:39.678267+0000","last_unstale":"2024-09-18T13:16:37.439536+0000","last_undegraded":"2024-09-18T13:16:37.439536+0000","last_fullsized":"2024-09-18T13:16:37.439536+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-18T13:16:37.480334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T13:16:37.480334+0000","last_clean_scrub_stamp":"2024-09-18T12:57:38.643767+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48256,"kb_used_data":3376,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94323584,"statfs":{"total":96636764160,"available":96587350016,"internally_reserved":0,"allocated":3457024,"data_stored":1323014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66356,"kb_used_data":3428,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305484,"statfs":{"total":96636764160,"available":96568815616,"internally_reserved":0,"allocated":3510272,"data_stored":1913358,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70520,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301320,"statfs":{"total":96636764160,"available":96564551680,"internally_reserved":0,"allocated":3514368,"data_stored":1913377,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60732,"kb_used_data":3372,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311108,"statfs":{"total":96636764160,"available":96574574592,"internally_reserved":0,"allocated":3452928,"data_stored":1322995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30035,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T13:17:19.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T13:17:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.461+0000 7f1022791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:17:19.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.470+0000 7f1022791640 1 Processor -- start 2024-09-18T13:17:19.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.470+0000 7f1022791640 1 -- start start 2024-09-18T13:17:19.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f1022791640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f101c09e580 0x7f101c13b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:17:19.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f1022791640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101c06f8f0 con 0x7f101c09da60 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f1022791640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f101c09f620 con 0x7f101c09e580 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f101b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f101c09e580 0x7f101c13b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f101bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f101c09da60 0x7f101c09de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33462/0 (socket says 172.21.15.120:33462) 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f101bfff640 1 -- 172.21.15.120:0/2862236608 learned_addr learned my addr 172.21.15.120:0/2862236608 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f101b7fe640 1 -- 172.21.15.120:0/2862236608 >> v1:172.21.15.120:6789/0 conn(0x7f101c09da60 legacy=0x7f101c09de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f101b7fe640 1 -- 172.21.15.120:0/2862236608 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c06fb20 con 0x7f101c09e580 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f101affd640 1 -- 172.21.15.120:0/2862236608 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752554612 0 0) 0x7f101c06f8f0 con 0x7f101c09da60 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.471+0000 7f101b7fe640 1 --2- 172.21.15.120:0/2862236608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09e580 0x7f101c13b260 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d61b001db4f3c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f101affd640 1 -- 172.21.15.120:0/2862236608 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1010009d90 con 0x7f101c09e580 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f101affd640 1 -- 172.21.15.120:0/2862236608 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f101000e230 con 0x7f101c09e580 2024-09-18T13:17:19.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f101affd640 1 -- 172.21.15.120:0/2862236608 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f101000e4d0 con 0x7f101c09e580 2024-09-18T13:17:19.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f1022791640 1 -- 172.21.15.120:0/2862236608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09e580 msgr2=0x7f101c13b260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f1022791640 1 --2- 172.21.15.120:0/2862236608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09e580 0x7f101c13b260 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f1022791640 1 -- 172.21.15.120:0/2862236608 shutdown_connections 2024-09-18T13:17:19.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f1022791640 1 --2- 172.21.15.120:0/2862236608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09e580 0x7f101c13b260 unknown :-1 s=CLOSED pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f1022791640 1 -- 172.21.15.120:0/2862236608 >> 172.21.15.120:0/2862236608 conn(0x7f101c06e970 msgr2=0x7f101c06ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:17:19.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f1022791640 1 -- 172.21.15.120:0/2862236608 shutdown_connections 2024-09-18T13:17:19.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.472+0000 7f1022791640 1 -- 172.21.15.120:0/2862236608 wait complete. 2024-09-18T13:17:19.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.473+0000 7f1022791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-18T13:17:19.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.474+0000 7f1022791640 1 Processor -- start 2024-09-18T13:17:19.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.474+0000 7f1022791640 1 -- start start 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.475+0000 7f1022791640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09da60 0x7f101c122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.475+0000 7f1022791640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f101c1226a0 con 0x7f101c09da60 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.475+0000 7f101bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09da60 0x7f101c122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.475+0000 7f101bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09da60 0x7f101c122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46160/0 (socket says 172.21.15.120:46160) 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.475+0000 7f101bfff640 1 -- 172.21.15.120:0/1879152089 learned_addr learned my addr 172.21.15.120:0/1879152089 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.476+0000 7f101bfff640 1 -- 172.21.15.120:0/1879152089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c122c30 con 0x7f101c09da60 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.476+0000 7f101bfff640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09da60 0x7f101c122ff0 crc :-1 s=READY pgs=13019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.476+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f100c004b80 con 0x7f101c09da60 2024-09-18T13:17:19.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.476+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f100c004ce0 con 0x7f101c09da60 2024-09-18T13:17:19.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.476+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c124a90 con 0x7f101c09da60 2024-09-18T13:17:19.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.476+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f100c007120 con 0x7f101c09da60 2024-09-18T13:17:19.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.476+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c122890 con 0x7f101c09da60 2024-09-18T13:17:19.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.477+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c09de70 con 0x7f101c09da60 2024-09-18T13:17:19.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.477+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f100c0072d0 con 0x7f101c09da60 2024-09-18T13:17:19.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.477+0000 7f1018ff9640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f100803e930 0x7f1008040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:17:19.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.477+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(723..723 src has 408..723) ==== 3431+0+0 (crc 0 0 0) 0x7f100c04fa30 con 0x7f101c09da60 2024-09-18T13:17:19.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.478+0000 7f101b7fe640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f100803e930 0x7f1008040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:17:19.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.478+0000 7f101b7fe640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f100803e930 0x7f1008040e40 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:17:19.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.482+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (crc 0 0 0) 0x7f100c00f230 con 0x7f101c09da60 2024-09-18T13:17:19.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.660+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f101c074ef0 con 0x7f101c09da60 2024-09-18T13:17:19.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.663+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f100c00a0c0 con 0x7f101c09da60 2024-09-18T13:17:19.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.664+0000 7f1018ff9640 1 -- 172.21.15.120:0/1879152089 <== mon.0 v2:172.21.15.120:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f100c00f230 con 0x7f101c09da60 2024-09-18T13:17:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f100803e930 msgr2=0x7f1008040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f100803e930 0x7f1008040e40 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09da60 msgr2=0x7f101c122ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:17:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09da60 0x7f101c122ff0 crc :-1 s=READY pgs=13019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 shutdown_connections 2024-09-18T13:17:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.176:6800/3363408531,v1:172.21.15.176:6801/3363408531] conn(0x7f100803e930 0x7f1008040e40 unknown :-1 s=CLOSED pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 --2- 172.21.15.120:0/1879152089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c09da60 0x7f101c122ff0 unknown :-1 s=CLOSED pgs=13019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:17:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 >> 172.21.15.120:0/1879152089 conn(0x7f101c06e970 msgr2=0x7f101c0a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:17:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 shutdown_connections 2024-09-18T13:17:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-18T13:17:19.666+0000 7f1022791640 1 -- 172.21.15.120:0/1879152089 wait complete. 2024-09-18T13:17:19.680 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T13:17:19.680 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T13:17:19.680 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T13:17:19.680 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:17:19.754 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T13:17:19.755 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T13:17:19.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:17:19.826 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T13:17:19.826 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T13:17:19.826 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:17:19.917 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T13:17:19.917 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T13:17:19.917 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:17:20.014 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T13:17:20.015 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T13:17:20.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T13:17:20.015 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:17:20.045 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T13:17:20.045 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T13:17:20.045 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T13:17:20.045 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:17:20.060 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T13:17:20.060 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T13:17:20.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-18T13:17:20.131 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-18T13:17:20.131 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T13:17:20.339 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-18T13:17:20.339 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T13:17:20.435 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-18T13:17:20.436 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T13:17:20.568 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-18T13:17:20.569 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T13:17:20.655 INFO:tasks.ceph:Archiving mon data... 2024-09-18T13:17:20.657 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396/data/mon.a.tgz 2024-09-18T13:17:20.657 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-18T13:17:20.672 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.sioWvAcPEg 2024-09-18T13:17:20.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sioWvAcPEg 2024-09-18T13:17:20.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.sioWvAcPEg 2024-09-18T13:17:20.908 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.sioWvAcPEg is 313KB 2024-09-18T13:17:21.003 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.sioWvAcPEg 2024-09-18T13:17:21.018 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T13:17:21.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T13:17:21.060 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T13:17:21.138 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T13:17:21.154 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T13:17:21.155 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T13:17:21.156 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396/remote/smithi120/crash 2024-09-18T13:17:21.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T13:17:21.202 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396/remote/smithi176/crash 2024-09-18T13:17:21.203 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T13:17:21.244 INFO:tasks.ceph:Compressing logs... 2024-09-18T13:17:21.244 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:17:21.247 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28048.log 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28008.log 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27968.log 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.28048.log: /var/log/ceph/ceph-client.admin.28008.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28048.log.gz 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28008.log.gz 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27968.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T13:17:21.324 INFO:teuthology.orchestra.run.smithi176.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27968.log.gz 2024-09-18T13:17:21.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27919.log 2024-09-18T13:17:21.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-18T13:17:21.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27919.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.27919.log.gz 2024-09-18T13:17:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28867.log 2024-09-18T13:17:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T13:17:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.28867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95984.log 2024-09-18T13:17:21.353 INFO:teuthology.orchestra.run.smithi120.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28867.log.gz 2024-09-18T13:17:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93801.log 2024-09-18T13:17:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94922.log 2024-09-18T13:17:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95817.log 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94922.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95984.log.gz 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94659.log 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94660.log 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94922.log.gz 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94659.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93801.log.gz 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96730.log 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96898.log 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94660.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94659.log.gz 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94522.log 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93389.log 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94660.log.gz 2024-09-18T13:17:21.354 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7%/var/log/ceph/ceph-client.admin.96898.log: -- replaced with /var/log/ceph/ceph-client.admin.96730.log.gz 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94522.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96898.log.gz 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93317.log 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97756.log 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93389.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94522.log.gz 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96835.log 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.95817.log.gz 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93389.log.gz 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30009.log 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97756.log.gz 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29647.log 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96835.log: /var/log/ceph/ceph-client.admin.30009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94609.log 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96835.log.gz 2024-09-18T13:17:21.355 INFO:teuthology.orchestra.run.smithi120.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30009.log.gz 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94746.log 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29647.log.gz 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94609.log: /var/log/ceph/ceph-client.admin.94746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94924.log 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94662.log 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94609.log.gz 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94924.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94746.log.gz 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96877.log 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94662.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94924.log.gz 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96280.log 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96921.log/var/log/ceph/ceph-client.admin.96280.log: 2024-09-18T13:17:21.356 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94662.log.gz 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96877.log.gz 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96280.log.gz 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97015.log 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96343.log 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96921.log: /var/log/ceph/ceph-client.admin.97015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94886.log 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96921.log.gz 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97015.log.gz 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93782.log 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94744.log 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94886.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96343.log.gz 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93782.log: gzip -5 --verbose -- 85.5% /var/log/ceph/ceph-client.admin.96427.log 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94886.log.gz 2024-09-18T13:17:21.357 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94501.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93782.log.gz 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94374.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94744.log.gz 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96213.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96427.log.gz 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95268.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94849.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4%/var/log/ceph/ceph-client.admin.95268.log: -- replaced with /var/log/ceph/ceph-client.admin.96213.log.gz 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94520.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.94501.log.gz 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29505.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94849.log: /var/log/ceph/ceph-client.admin.94520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29815.log 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29505.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.94520.log.gz 2024-09-18T13:17:21.358 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.94849.log.gz 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29505.log.gz 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94608.log 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93763.log 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29815.log.gz 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96301.log 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97632.log 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94608.log.gz 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93763.log.gz 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96163.log 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96301.log.gz 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97632.log: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.93317.log.gz 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94661.log 2024-09-18T13:17:21.359 INFO:teuthology.orchestra.run.smithi120.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97632.log.gz 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29814.log 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96163.log.gz 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93608.log 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr: 86.6%/var/log/ceph/ceph-client.admin.31501.log: -- replaced with /var/log/ceph/ceph-client.admin.29814.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94661.log.gz 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96856.log 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.93608.log: /var/log/ceph/ceph-client.admin.94992.log 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96856.log: 92.1% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95268.log.gz 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30697.log 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96856.log.gz 2024-09-18T13:17:21.360 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94992.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.93608.log.gz 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94745.log 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.30697.log: gzip -5 --verbose/var/log/ceph/ceph.audit.log: -- /var/log/ceph/ceph-client.admin.94559.log 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97128.log 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94559.log: 90.7% 92.9% -- replaced with /var/log/ceph/ceph-client.admin.94374.log.gz 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.94745.log.gz 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94992.log.gz 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29817.log 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.94559.log.gz 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94610.log 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97128.log.gz 2024-09-18T13:17:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96966.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29817.log: /var/log/ceph/ceph-client.admin.94610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94923.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29817.log.gz 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29052.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94610.log.gz 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94923.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96966.log.gz 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96658.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr: 85.5%/var/log/ceph/ceph-client.admin.29052.log: -- replaced with /var/log/ceph/ceph-client.admin.94923.log.gz 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96016.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.29052.log.gz 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96586.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96016.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96658.log.gz 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96632.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97464.log 2024-09-18T13:17:21.362 INFO:teuthology.orchestra.run.smithi120.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96586.log.gz 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96632.log: gzip -5 --verbose -- 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96632.log.gz 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.31554.log 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96449.log 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31554.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97464.log.gz 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94294.log 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96449.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94813.log 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96449.log.gz 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97338.log 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94294.log: /var/log/ceph/ceph-client.admin.94813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31535.log 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.94813.log.gz 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97338.log: gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.admin.94294.log.gz 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.29370.log 2024-09-18T13:17:21.363 INFO:teuthology.orchestra.run.smithi120.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97338.log.gz 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96942.log 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96991.log 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96942.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29370.log.gz 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29024.log 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96942.log.gz 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29816.log 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96991.log: /var/log/ceph/ceph-client.admin.29024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31631.log 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr: 85.2%/var/log/ceph/ceph-client.admin.29816.log: -- replaced with /var/log/ceph/ceph-client.admin.29024.log.gz 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96991.log.gz 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31535.log.gz 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29816.log.gz 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96515.log 2024-09-18T13:17:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96772.log 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96515.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31631.log.gz 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93427.log 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96515.log.gz 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97506.log 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93427.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96772.log.gz 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94558.log 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93820.log 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97506.log.gz 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94558.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.96016.log.gz 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96189.log 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.94558.log.gz 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97296.log 2024-09-18T13:17:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93820.log: gzip/var/log/ceph/ceph-client.admin.96189.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.93427.log.gz/var/log/ceph/ceph-client.admin.97296.log: 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96189.log.gz 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.30697.log.gz 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29281.log 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97296.log.gz 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.93820.log.gz 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93839.log 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96751.log 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29281.log: /var/log/ceph/ceph-client.admin.93839.log: gzip 85.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.29281.log.gz 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97212.log 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93646.log 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96751.log.gz 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96450.log 2024-09-18T13:17:21.366 INFO:teuthology.orchestra.run.smithi120.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97212.log.gz 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31651.log 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94885.log 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93839.log.gz 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96450.log.gz 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31651.log: 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31593.log 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.94885.log: --verbose -- /var/log/ceph/ceph-client.admin.96541.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31651.log.gz 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29649.log 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7%/var/log/ceph/ceph-client.admin.96541.log: -- replaced with /var/log/ceph/ceph-client.admin.94885.log.gz 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93646.log.gz 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.94521.log 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96541.log.gz 2024-09-18T13:17:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93957.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29649.log.gz 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96238.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93957.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27724.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr: 88.6%/var/log/ceph/ceph-client.admin.96238.log: -- replaced with /var/log/ceph/ceph-client.admin.94521.log.gz 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97380.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96238.log.gz 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95056.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.tmp-client.admin.27724.log: /var/log/ceph/ceph-client.admin.97380.log: gzip 67.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.94975.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.27724.log.gz 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97380.log.gz 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96542.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95056.log: /var/log/ceph/ceph-client.admin.94975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96793.log 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96542.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.94975.log.gz 2024-09-18T13:17:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:gzip 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96542.log.gz 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29421.log 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96793.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96793.log.gz 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29421.log: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97170.log 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29421.log.gz 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.93957.log.gz 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29463.log 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29925.log 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97170.log.gz 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29463.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29463.log.gz 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28788.log 92.0% 2024-09-18T13:17:21.369 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95056.log.gz 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94812.log 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr: 85.5% 94.2% -- replaced with /var/log/ceph/ceph-client.admin.31593.log.gz 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29925.log.gz 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.28788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29345.log 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr: 86.1%/var/log/ceph/ceph-client.admin.94812.log: -- replaced with /var/log/ceph/ceph-client.admin.28788.log.gz 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94557.log 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96709.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94812.log.gz 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29345.log.gz 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94557.log: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96814.log 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95039.log 2024-09-18T13:17:21.370 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96709.log.gz 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94557.log.gz 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95315.log 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95498.log 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95039.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96814.log.gz 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29646.log 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.95039.log.gz 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29648.log 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97674.log 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29646.log.gz 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96364.log 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% 91.7% -- replaced with /var/log/ceph/ceph-client.admin.95498.log.gz 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29648.log.gz 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97254.log 2024-09-18T13:17:21.371 INFO:teuthology.orchestra.run.smithi120.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97674.log.gz 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96610.log 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97254.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96364.log.gz 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96322.log 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.95315.log.gz 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97254.log.gz 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95605.log 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96610.log.gz 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96259.log 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95605.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96322.log.gz 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29547.log 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97548.log 2024-09-18T13:17:21.372 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96259.log.gz 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96494.log 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29547.log.gz 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96406.log 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97548.log.gz 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30228.log 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96494.log.gz 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96385.log 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97422.log 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96406.log.gz/var/log/ceph/ceph-client.admin.30228.log: 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97590.log 2024-09-18T13:17:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93906.log 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96385.log.gz 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr: 92.3% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97422.log.gz 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95605.log.gz/var/log/ceph/ceph-client.admin.97590.log: 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94848.log 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.93906.log: -5 --verbose 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97590.log.gz 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.97716.log 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96682.log 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94663.log 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94848.log.gz 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97716.log.gz 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93906.log.gz 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96682.log: -- /var/log/ceph/ceph-client.admin.29967.log 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94663.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96682.log.gz 2024-09-18T13:17:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31670.log 2024-09-18T13:17:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.29967.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94663.log.gz 2024-09-18T13:17:21.375 INFO:teuthology.orchestra.run.smithi120.stderr: 85.9%/var/log/ceph/ceph-client.admin.31670.log: -- replaced with /var/log/ceph/ceph-client.admin.29967.log.gz 2024-09-18T13:17:21.375 INFO:teuthology.orchestra.run.smithi120.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.30228.log.gz 2024-09-18T13:17:21.505 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.3.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T13:17:21.734 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31670.log.gz 2024-09-18T13:17:22.821 INFO:teuthology.orchestra.run.smithi120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T13:17:27.398 INFO:teuthology.orchestra.run.smithi120.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T13:17:27.699 INFO:teuthology.orchestra.run.smithi120.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T13:17:27.701 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-18T13:17:27.701 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m6.442s 2024-09-18T13:17:27.701 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m14.060s 2024-09-18T13:17:27.701 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m0.658s 2024-09-18T13:17:27.720 INFO:teuthology.orchestra.run.smithi176.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T13:17:28.052 INFO:teuthology.orchestra.run.smithi176.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-18T13:17:28.054 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-18T13:17:28.054 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m6.748s 2024-09-18T13:17:28.054 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m12.822s 2024-09-18T13:17:28.054 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.501s 2024-09-18T13:17:28.055 INFO:tasks.ceph:Archiving logs... 2024-09-18T13:17:28.055 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396/remote/smithi120/log 2024-09-18T13:17:28.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:17:30.456 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396/remote/smithi176/log 2024-09-18T13:17:30.457 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:17:32.526 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T13:17:32.535 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T13:17:32.535 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:17:32.538 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:17:32.631 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T13:17:32.639 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T13:17:32.640 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:17:32.643 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:17:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:17:32.660 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:17:32.662 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:17:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-18T13:17:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +512us[ +516us] +/- 37ms 2024-09-18T13:17:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 -2181us[-2181us] +/- 58ms 2024-09-18T13:17:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +1668us[+1668us] +/- 75ms 2024-09-18T13:17:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:17:32.665 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:17:32.665 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-18T13:17:32.665 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 +496us[ +497us] +/- 36ms 2024-09-18T13:17:32.665 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -2186us[-2185us] +/- 58ms 2024-09-18T13:17:32.665 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +1648us[+1648us] +/- 75ms 2024-09-18T13:17:32.665 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:17:32.666 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T13:17:32.675 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T13:17:32.675 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T13:17:32.724 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:17:32.791 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:17:32.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T13:17:32.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:17:32.885 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T13:17:32.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:17:32.914 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T13:17:32.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T13:17:32.955 INFO:teuthology.task.internal:Duration was 1620.635227 seconds 2024-09-18T13:17:32.956 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T13:17:33.006 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T13:17:33.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:17:33.008 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:17:33.047 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:17:33.049 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:17:33.400 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T13:17:33.400 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-18T13:17:33.401 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:17:33.462 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-18T13:17:33.462 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:17:33.504 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T13:17:33.505 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:17:33.508 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:17:33.572 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T13:17:33.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:17:33.576 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:17:33.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T13:17:33.723 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T13:17:33.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:17:33.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:17:33.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T13:17:33.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:17:33.791 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:17:33.811 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-18T13:17:33.836 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-18T13:17:33.853 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:17:33.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:17:33.879 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:17:33.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:17:33.906 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T13:17:33.915 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T13:17:33.916 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396/remote/smithi120 2024-09-18T13:17:33.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:17:33.953 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/nmordech-2024-09-18_12:39:24-crimson-rados-main-distro-crimson-smithi/7911396/remote/smithi176 2024-09-18T13:17:33.953 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:17:33.986 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T13:17:33.986 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:17:33.990 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:17:34.036 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T13:17:34.047 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T13:17:34.047 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T13:17:34.082 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T13:17:34.082 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:17:34.085 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:17:34.097 INFO:teuthology.orchestra.run.smithi120.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 13:17 /home/ubuntu/cephtest 2024-09-18T13:17:34.099 INFO:teuthology.orchestra.run.smithi176.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 13:17 /home/ubuntu/cephtest 2024-09-18T13:17:34.101 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T13:17:34.133 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T13:17:34.234 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} duration: 1620.6352269649506 flavor: crimson owner: scheduled_nmordech@teuthology success: true 2024-09-18T13:17:34.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T13:17:34.319 INFO:teuthology.run:pass