2024-09-11T14:00:13.414 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T14:00:13.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:00:13.521 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306 branch: wip-matanb-crimson-testing-sep11 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7901306' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-sep11 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: e7a65bf96d25c503998be3c193e951647cc62cab ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: e7a65bf96d25c503998be3c193e951647cc62cab selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 2853 sha1: e7a65bf96d25c503998be3c193e951647cc62cab sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOkLc/dPfK+VVTmm03SbPZn9jQcplhId/YPxp8TCojEFJUMrai8JgDRvIQmae+PavDkfLDsndsfyOVPk9OfzE/k= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPO3pxWzuFuif+h4uCCgMOGRNx4HT21O/9n0xO/9e3Gvh94f+JXNwHTzKUSsWsL60Xpdsou19j0uHOwJHcRdZ0= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_13:53:46 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T14:00:13.521 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-11T14:00:13.522 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-11T14:00:13.522 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T14:00:13.523 INFO:teuthology.task.internal:Checking packages... 2024-09-11T14:00:13.544 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'e7a65bf96d25c503998be3c193e951647cc62cab' 2024-09-11T14:00:13.544 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T14:00:13.544 INFO:teuthology.packaging:ref: None 2024-09-11T14:00:13.545 INFO:teuthology.packaging:tag: None 2024-09-11T14:00:13.545 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-sep11 2024-09-11T14:00:13.545 INFO:teuthology.packaging:sha1: e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:00:13.545 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-sep11 2024-09-11T14:00:13.723 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4884.ge7a65bf9 2024-09-11T14:00:13.725 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T14:00:13.735 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T14:00:13.735 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T14:00:13.749 INFO:teuthology.task.internal:Saving configuration 2024-09-11T14:00:13.762 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T14:00:13.774 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T14:00:13.799 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 13:55:09.305508', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOkLc/dPfK+VVTmm03SbPZn9jQcplhId/YPxp8TCojEFJUMrai8JgDRvIQmae+PavDkfLDsndsfyOVPk9OfzE/k='} 2024-09-11T14:00:13.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 13:55:09.307219', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPO3pxWzuFuif+h4uCCgMOGRNx4HT21O/9n0xO/9e3Gvh94f+JXNwHTzKUSsWsL60Xpdsou19j0uHOwJHcRdZ0='} 2024-09-11T14:00:13.817 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T14:00:13.828 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-11T14:00:13.829 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T14:00:13.829 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T14:00:13.895 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc2ea0bfbe0>, signals=[15]) 2024-09-11T14:00:13.895 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T14:00:13.906 INFO:teuthology.task.internal:Opening connections... 2024-09-11T14:00:13.906 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-09-11T14:00:13.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:00:13.982 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T14:00:13.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:00:14.059 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T14:00:14.070 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-09-11T14:00:14.088 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-09-11T14:00:14.088 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-09-11T14:00:14.146 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-09-11T14:00:14.146 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-09-11T14:00:14.146 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:00:14.147 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:00:14.148 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-09-11T14:00:14.172 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-11T14:00:14.190 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-11T14:00:14.191 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-11T14:00:14.248 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:00:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:00:14.250 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-11T14:00:14.273 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T14:00:14.282 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T14:00:14.295 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T14:00:14.296 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:00:14.298 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:00:14.314 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T14:00:14.325 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T14:00:14.326 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:00:14.357 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:00:14.454 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T14:00:14.507 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T14:00:14.525 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-11T14:00:14.525 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-11T14:00:14.525 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:00:14.526 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:00:14.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:00:14.543 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-11T14:00:14.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:00:14.544 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-11T14:00:14.601 INFO:teuthology.orchestra.run.smithi097.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:00:14.601 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.14.0-503.el9.x86_64 2024-09-11T14:00:14.601 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum install -y kernel 2024-09-11T14:00:14.602 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:00:14.602 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-503.el9.x86_64 2024-09-11T14:00:14.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-09-11T14:00:17.466 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.2 MB 00:01 2024-09-11T14:00:19.361 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-09-11T14:00:19.805 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-11T14:00:21.770 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-11T14:00:26.038 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-11T14:00:26.179 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-11T14:00:27.488 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-11T14:00:27.588 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 94 kB/s | 19 kB 00:00 2024-09-11T14:00:28.258 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T14:00:28.742 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T14:00:33.623 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-11T14:00:34.231 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-09-11T14:00:35.638 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:00:35.638 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:00:35.722 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:00:35.731 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:00:35.731 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2024-09-11T14:00:35.731 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Install 4 Packages 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 79 M 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 126 M 2024-09-11T14:00:35.732 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:00:36.150 INFO:teuthology.orchestra.run.smithi097.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 77 kB/s | 23 kB 00:00 2024-09-11T14:00:36.245 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:00:36.245 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:00:36.347 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:00:36.358 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:00:36.359 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-09-11T14:00:36.359 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:00:36.359 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 79 M 2024-09-11T14:00:36.359 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 126 M 2024-09-11T14:00:36.359 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:00:36.607 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 175 kB/s | 23 kB 00:00 2024-09-11T14:00:39.816 INFO:teuthology.orchestra.run.smithi097.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:03 2024-09-11T14:00:41.041 INFO:teuthology.orchestra.run.smithi097.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.8 MB/s | 29 MB 00:04 2024-09-11T14:00:43.565 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-11T14:00:45.816 INFO:teuthology.orchestra.run.smithi097.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.5 MB/s | 35 MB 00:09 2024-09-11T14:00:45.816 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:00:45.816 INFO:teuthology.orchestra.run.smithi097.stdout:Total 7.8 MB/s | 79 MB 00:10 2024-09-11T14:00:46.503 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:00:46.847 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:00:46.847 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:00:47.807 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:00:47.807 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:00:49.572 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.2 MB/s | 29 MB 00:12 2024-09-11T14:00:50.243 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:00:50.903 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:00:50.985 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:00:52.125 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.2 MB/s | 35 MB 00:15 2024-09-11T14:00:52.125 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:00:52.125 INFO:teuthology.orchestra.run.smithi117.stdout:Total 5.0 MB/s | 79 MB 00:15 2024-09-11T14:00:52.806 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:00:53.166 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:00:53.167 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:00:53.799 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:00:53.928 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:00:54.110 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:00:54.110 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:00:56.556 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:00:57.206 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:00:57.299 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:00:58.766 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:00:58.870 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:00.077 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:01:00.216 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:01:03.752 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:05.082 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:01:05.324 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:10.199 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:42.212 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:42.251 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:42.604 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:42.605 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:01:42.605 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:01:42.605 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:01:43.409 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:01:43.787 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:01:43.870 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:01:43.870 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:01:43.870 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:01:43.870 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:01:43.870 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T14:01:43.871 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:01:43.871 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:01:43.929 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:01:43.929 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:01:43.929 DEBUG:teuthology.orchestra.run.smithi097:> sudo rpm -qi grub2-tools 2024-09-11T14:01:43.965 INFO:teuthology.orchestra.run.smithi097.stdout:Name : grub2-tools 2024-09-11T14:01:43.965 INFO:teuthology.orchestra.run.smithi097.stdout:Epoch : 1 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Version : 2.06 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Release : 82.el9 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: x86_64 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Group : Unspecified 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Size : 8274670 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:License : GPLv3+ 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:01:43.966 INFO:teuthology.orchestra.run.smithi097.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:Packager : builder@centos.org 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:Vendor : CentOS 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:Summary : Support tools for GRUB. 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:Description : 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout:hardware devices. 2024-09-11T14:01:43.967 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:01:43.968 INFO:teuthology.orchestra.run.smithi097.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:01:43.968 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:01:43.969 INFO:teuthology.task.kernel:Updating grub on smithi097 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:01:43.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:01:44.582 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-09-11T14:01:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:01:45.941 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-09-11T14:01:45.944 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-11T14:01:45.959 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.VXRiOYy9Sk 2024-09-11T14:01:45.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VXRiOYy9Sk 2024-09-11T14:01:46.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.VXRiOYy9Sk 2024-09-11T14:01:46.164 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.VXRiOYy9Sk is 6KB 2024-09-11T14:01:46.213 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.VXRiOYy9Sk 2024-09-11T14:01:46.227 DEBUG:teuthology.orchestra.run.smithi097:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:01:46.297 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:01:46.297 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:01:46.297 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:01:46.297 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:01:46.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:01:46.463 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-09-11T14:01:47.894 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:47.934 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:48.245 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:48.245 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:01:48.246 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:01:48.246 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:01:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:01:49.149 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:01:49.526 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:01:49.622 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:01:49.623 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:01:49.623 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:01:49.623 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:01:49.623 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:01:49.623 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-11T14:01:49.623 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:01:49.623 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:01:49.682 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:01:49.682 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:01:49.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 82.el9 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8274670 2024-09-11T14:01:49.715 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:01:49.716 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:01:49.717 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-09-11T14:01:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:01:49.717 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:01:49.718 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:01:49.718 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:01:49.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:01:50.379 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-09-11T14:01:51.681 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:01:51.702 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-09-11T14:01:51.704 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-11T14:01:51.741 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.VZZ8MPHHXq 2024-09-11T14:01:51.742 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VZZ8MPHHXq 2024-09-11T14:01:51.809 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.VZZ8MPHHXq 2024-09-11T14:01:51.956 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.VZZ8MPHHXq is 6KB 2024-09-11T14:01:52.004 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.VZZ8MPHHXq 2024-09-11T14:01:52.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:01:52.082 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:01:52.082 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:01:52.082 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:01:52.082 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:01:52.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:01:52.237 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-09-11T14:02:16.490 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T14:02:16.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-11T14:02:16.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:02:22.245 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-11T14:02:22.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T14:02:22.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:02:34.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-11T14:02:40.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-11T14:02:43.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-11T14:02:43.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:02:47.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-11T14:02:49.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T14:02:49.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:02:52.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-11T14:02:59.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-11T14:02:59.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:03:04.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T14:03:04.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:03:17.441 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-11T14:03:23.072 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-11T14:03:32.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-11T14:03:32.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:03:32.736 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-11T14:03:33.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-11T14:03:33.215 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:03:33.216 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-11T14:03:33.255 INFO:teuthology.orchestra.run.smithi097.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:03:33.255 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:03:33.255 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:03:33.255 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:03:34.256 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T14:03:34.257 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:03:34.338 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-09-11T14:03:34.368 DEBUG:teuthology.parallel:result is None 2024-09-11T14:03:38.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T14:03:38.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:03:38.449 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-11T14:03:38.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T14:03:38.893 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:03:38.893 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-11T14:03:38.907 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:03:38.908 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:03:38.908 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:03:38.908 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:03:39.909 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-11T14:03:39.909 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:03:40.031 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-09-11T14:03:40.057 DEBUG:teuthology.parallel:result is None 2024-09-11T14:03:40.057 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T14:03:40.064 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T14:03:40.064 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:03:40.070 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:03:40.110 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T14:03:40.116 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T14:03:40.127 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T14:03:40.127 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:03:40.129 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:03:40.199 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T14:03:40.205 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T14:03:40.205 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:03:40.208 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:03:40.241 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:03:40.253 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:03:40.293 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:03:40.313 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:03:40.315 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T14:03:40.322 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T14:03:40.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:03:40.325 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:03:40.396 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T14:03:40.405 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T14:03:40.405 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:03:40.408 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:03:40.426 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:03:40.506 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:03:40.561 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:03:40.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:03:40.687 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:03:40.687 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:03:40.754 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:03:40.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:03:40.918 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:03:40.959 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:03:40.997 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:03:40.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:03:41.058 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-09-11T14:03:41.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-11T14:03:41.105 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:03:41.160 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:03:41.619 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T14:03:41.627 INFO:teuthology.task.internal:Starting timer... 2024-09-11T14:03:41.627 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T14:03:41.641 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T14:03:41.649 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T14:03:41.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo service auditd rotate 2024-09-11T14:03:41.716 INFO:teuthology.orchestra.run.smithi097.stdout:Rotating logs: 2024-09-11T14:03:41.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-11T14:03:41.765 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-11T14:03:41.767 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T14:03:41.767 DEBUG:teuthology.orchestra.run.smithi097:> /usr/sbin/getenforce 2024-09-11T14:03:41.792 INFO:teuthology.orchestra.run.smithi097.stdout:Permissive 2024-09-11T14:03:41.792 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-11T14:03:41.812 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-11T14:03:41.813 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi097.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-09-11T14:03:41.813 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:03:41.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:03:41.860 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:03:41.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:03:41.885 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T14:03:41.885 DEBUG:teuthology.orchestra.run.smithi097:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:03:41.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:03:41.969 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T14:03:41.978 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T14:03:41.990 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T14:03:41.991 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T14:07:24.292 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-09-11T14:07:24.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-11T14:07:24.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:07:24.371 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-11T14:07:24.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-11T14:07:24.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T14:07:24.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:07:24.530 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-11T14:07:24.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T14:07:24.564 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T14:07:24.574 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T14:07:24.574 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:07:24.575 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:07:24.577 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:07:24.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:07:24.603 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:07:24.618 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:07:24.634 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:07:24.642 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: ntpd: command not found 2024-09-11T14:07:24.648 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:07:24.653 INFO:teuthology.orchestra.run.smithi097.stdout:506 Cannot talk to daemon 2024-09-11T14:07:24.667 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:07:24.672 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-11T14:07:24.681 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:07:24.683 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-11T14:07:24.697 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:07:24.712 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:07:24.731 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:07:24.735 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:07:24.735 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-11T14:07:24.735 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.735 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.736 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.736 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.769 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:07:24.772 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:07:24.772 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-11T14:07:24.773 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.773 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.773 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.773 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:07:24.773 INFO:teuthology.run_tasks:Running task install... 2024-09-11T14:07:24.782 DEBUG:teuthology.task.install:project ceph 2024-09-11T14:07:24.782 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}} 2024-09-11T14:07:24.782 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'} 2024-09-11T14:07:24.782 INFO:teuthology.task.install:Using flavor: crimson 2024-09-11T14:07:24.787 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T14:07:24.788 INFO:teuthology.task.install:extra packages: [] 2024-09-11T14:07:24.788 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'tag': None, 'wait_for_package': False} 2024-09-11T14:07:24.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:07:24.791 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'tag': None, 'wait_for_package': False} 2024-09-11T14:07:24.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:07:24.936 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/ 2024-09-11T14:07:24.936 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4884.ge7a65bf9 2024-09-11T14:07:24.944 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/ 2024-09-11T14:07:24.944 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4884.ge7a65bf9 2024-09-11T14:07:25.050 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:07:25.050 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:07:25.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:07:25.055 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:07:25.055 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:07:25.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:07:25.076 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:07:25.076 DEBUG:teuthology.orchestra.run.smithi097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e7a65bf96d25c503998be3c193e951647cc62cab/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:07:25.082 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:07:25.082 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e7a65bf96d25c503998be3c193e951647cc62cab/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:07:25.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:07:25.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:07:25.217 DEBUG:teuthology.orchestra.run.smithi097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:07:25.223 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:07:25.281 INFO:teuthology.orchestra.run.smithi097.stdout:check_obsoletes = 1 2024-09-11T14:07:25.282 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum clean all 2024-09-11T14:07:25.287 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-11T14:07:25.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-11T14:07:25.512 INFO:teuthology.orchestra.run.smithi097.stdout:45 files removed 2024-09-11T14:07:25.512 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-11T14:07:25.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-radosgw 2024-09-11T14:07:25.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw 2024-09-11T14:07:26.091 INFO:teuthology.orchestra.run.smithi097.stdout:ceph packages for x86_64 333 kB/s | 89 kB 00:00 2024-09-11T14:07:26.117 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 302 kB/s | 89 kB 00:00 2024-09-11T14:07:26.383 INFO:teuthology.orchestra.run.smithi097.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T14:07:26.409 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T14:07:26.658 INFO:teuthology.orchestra.run.smithi097.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-11T14:07:26.685 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-11T14:07:29.460 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-11T14:07:30.042 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.2 MB 00:03 2024-09-11T14:07:32.035 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-11T14:07:38.202 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-11T14:07:39.744 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-11T14:07:40.507 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T14:07:42.417 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 20 MB 00:11 2024-09-11T14:07:46.046 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-11T14:07:47.559 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-11T14:07:48.440 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:07:48.449 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:07:48.449 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:07:48.449 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:07:48.450 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:07:48.450 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 10 M 2024-09-11T14:07:48.450 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2024-09-11T14:07:48.450 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:07:48.450 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.8 M 2024-09-11T14:07:48.450 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:07:48.450 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.1 M 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 20 M 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 25 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 808 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:07:48.451 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 557 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.4 M 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 45 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 143 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 160 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 315 k 2024-09-11T14:07:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 303 k 2024-09-11T14:07:48.453 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 99 k 2024-09-11T14:07:48.453 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:07:48.453 INFO:teuthology.orchestra.run.smithi097.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:07:48.453 INFO:teuthology.orchestra.run.smithi097.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:07:48.453 INFO:teuthology.orchestra.run.smithi097.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:07:48.453 INFO:teuthology.orchestra.run.smithi097.stdout:Installing weak dependencies: 2024-09-11T14:07:48.453 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:07:48.454 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:07:48.454 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:07:48.454 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:07:48.454 INFO:teuthology.orchestra.run.smithi097.stdout:Install 31 Packages 2024-09-11T14:07:48.454 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 2 Packages 2024-09-11T14:07:48.454 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:07:48.455 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 60 M 2024-09-11T14:07:48.455 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:07:49.376 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-11T14:07:49.448 INFO:teuthology.orchestra.run.smithi097.stdout:(1/33): ceph-base-19.3.0-4884.ge7a65bf9.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-11T14:07:49.506 INFO:teuthology.orchestra.run.smithi097.stdout:(2/33): ceph-selinux-19.3.0-4884.ge7a65bf9.el9. 432 kB/s | 25 kB 00:00 2024-09-11T14:07:49.598 INFO:teuthology.orchestra.run.smithi097.stdout:(3/33): libcephfs2-19.3.0-4884.ge7a65bf9.el9.x8 8.6 MB/s | 808 kB 00:00 2024-09-11T14:07:49.698 INFO:teuthology.orchestra.run.smithi097.stdout:(4/33): ceph-radosgw-19.3.0-4884.ge7a65bf9.el9. 13 MB/s | 10 MB 00:00 2024-09-11T14:07:49.732 INFO:teuthology.orchestra.run.smithi097.stdout:(5/33): libradosstriper1-19.3.0-4884.ge7a65bf9. 4.1 MB/s | 557 kB 00:00 2024-09-11T14:07:49.790 INFO:teuthology.orchestra.run.smithi097.stdout:(6/33): python3-ceph-argparse-19.3.0-4884.ge7a6 774 kB/s | 45 kB 00:00 2024-09-11T14:07:49.866 INFO:teuthology.orchestra.run.smithi097.stdout:(7/33): python3-ceph-common-19.3.0-4884.ge7a65b 1.9 MB/s | 143 kB 00:00 2024-09-11T14:07:49.966 INFO:teuthology.orchestra.run.smithi097.stdout:(8/33): librgw2-19.3.0-4884.ge7a65bf9.el9.x86_6 20 MB/s | 5.4 MB 00:00 2024-09-11T14:07:49.991 INFO:teuthology.orchestra.run.smithi097.stdout:(9/33): python3-cephfs-19.3.0-4884.ge7a65bf9.el 1.2 MB/s | 160 kB 00:00 2024-09-11T14:07:50.017 INFO:teuthology.orchestra.run.smithi097.stdout:(10/33): python3-rados-19.3.0-4884.ge7a65bf9.el 6.1 MB/s | 315 kB 00:00 2024-09-11T14:07:50.042 INFO:teuthology.orchestra.run.smithi097.stdout:(11/33): python3-rbd-19.3.0-4884.ge7a65bf9.el9. 5.9 MB/s | 303 kB 00:00 2024-09-11T14:07:50.067 INFO:teuthology.orchestra.run.smithi097.stdout:(12/33): python3-rgw-19.3.0-4884.ge7a65bf9.el9. 1.9 MB/s | 99 kB 00:00 2024-09-11T14:07:50.251 INFO:teuthology.orchestra.run.smithi097.stdout:(13/33): ceph-common-19.3.0-4884.ge7a65bf9.el9. 15 MB/s | 20 MB 00:01 2024-09-11T14:07:50.272 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T14:07:50.360 INFO:teuthology.orchestra.run.smithi097.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-09-11T14:07:50.385 INFO:teuthology.orchestra.run.smithi097.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 538 kB/s | 171 kB 00:00 2024-09-11T14:07:50.410 INFO:teuthology.orchestra.run.smithi097.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-11T14:07:50.435 INFO:teuthology.orchestra.run.smithi097.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 871 kB/s | 160 kB 00:00 2024-09-11T14:07:50.486 INFO:teuthology.orchestra.run.smithi097.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-09-11T14:07:50.520 INFO:teuthology.orchestra.run.smithi097.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-11T14:07:50.545 INFO:teuthology.orchestra.run.smithi097.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-11T14:07:50.570 INFO:teuthology.orchestra.run.smithi097.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-11T14:07:50.596 INFO:teuthology.orchestra.run.smithi097.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-11T14:07:50.621 INFO:teuthology.orchestra.run.smithi097.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 626 kB/s | 47 kB 00:00 2024-09-11T14:07:50.671 INFO:teuthology.orchestra.run.smithi097.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-09-11T14:07:50.696 INFO:teuthology.orchestra.run.smithi097.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-11T14:07:50.721 INFO:teuthology.orchestra.run.smithi097.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 301 kB/s | 26 kB 00:00 2024-09-11T14:07:50.747 INFO:teuthology.orchestra.run.smithi097.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T14:07:50.780 INFO:teuthology.orchestra.run.smithi097.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T14:07:50.823 INFO:teuthology.orchestra.run.smithi097.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-11T14:07:50.873 INFO:teuthology.orchestra.run.smithi097.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-11T14:07:50.948 INFO:teuthology.orchestra.run.smithi097.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-11T14:07:51.065 INFO:teuthology.orchestra.run.smithi097.stdout:(32/33): librados2-19.3.0-4884.ge7a65bf9.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-11T14:07:51.140 INFO:teuthology.orchestra.run.smithi097.stdout:(33/33): librbd1-19.3.0-4884.ge7a65bf9.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-11T14:07:51.145 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:07:51.145 INFO:teuthology.orchestra.run.smithi097.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-11T14:07:51.254 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:07:51.290 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:07:51.290 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:07:51.969 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:07:51.969 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:07:53.487 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:07:54.000 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:07:54.059 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:07:54.151 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:07:54.240 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:07:54.269 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:07:54.332 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:07:54.378 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:07:54.407 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:07:54.432 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:07:54.455 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:07:54.481 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:07:54.640 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:07:54.671 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:07:54.706 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:07:54.750 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 11/35 2024-09-11T14:07:54.779 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:07:54.857 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:07:54.884 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:07:54.973 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:07:55.017 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:07:55.134 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:07:55.168 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:07:55.218 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:07:55.249 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:07:55.279 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:07:55.315 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:07:55.620 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T14:07:55.697 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:07:55.749 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:07:55.841 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:07:55.871 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 24/35 2024-09-11T14:07:55.907 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:07:56.500 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:07:56.527 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:07:56.607 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:07:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 28/35 2024-09-11T14:07:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 29/35 2024-09-11T14:07:57.996 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:07:58.009 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:07:58.009 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:07:58.009 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:07:58.009 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 10 M 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.8 M 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.1 M 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 20 M 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 25 k 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:07:58.010 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 808 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 557 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.4 M 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:07:58.011 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 45 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 143 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 160 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 315 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 303 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 99 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:07:58.012 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-11T14:07:58.013 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:07:58.013 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:07:58.013 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:07:58.013 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:07:58.013 INFO:teuthology.orchestra.run.smithi117.stdout:Install 31 Packages 2024-09-11T14:07:58.013 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 2 Packages 2024-09-11T14:07:58.013 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:07:58.014 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 60 M 2024-09-11T14:07:58.014 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:07:58.920 INFO:teuthology.orchestra.run.smithi117.stdout:(1/33): ceph-base-19.3.0-4884.ge7a65bf9.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-11T14:07:58.970 INFO:teuthology.orchestra.run.smithi117.stdout:(2/33): ceph-selinux-19.3.0-4884.ge7a65bf9.el9. 506 kB/s | 25 kB 00:00 2024-09-11T14:07:59.129 INFO:teuthology.orchestra.run.smithi117.stdout:(3/33): ceph-radosgw-19.3.0-4884.ge7a65bf9.el9. 13 MB/s | 10 MB 00:00 2024-09-11T14:07:59.171 INFO:teuthology.orchestra.run.smithi117.stdout:(4/33): libcephfs2-19.3.0-4884.ge7a65bf9.el9.x8 3.9 MB/s | 808 kB 00:00 2024-09-11T14:07:59.186 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:07:59.204 INFO:teuthology.orchestra.run.smithi117.stdout:(5/33): libradosstriper1-19.3.0-4884.ge7a65bf9. 7.3 MB/s | 557 kB 00:00 2024-09-11T14:07:59.226 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:07:59.263 INFO:teuthology.orchestra.run.smithi117.stdout:(6/33): python3-ceph-argparse-19.3.0-4884.ge7a6 773 kB/s | 45 kB 00:00 2024-09-11T14:07:59.355 INFO:teuthology.orchestra.run.smithi117.stdout:(7/33): python3-ceph-common-19.3.0-4884.ge7a65b 1.5 MB/s | 143 kB 00:00 2024-09-11T14:07:59.547 INFO:teuthology.orchestra.run.smithi117.stdout:(8/33): ceph-common-19.3.0-4884.ge7a65bf9.el9.x 17 MB/s | 20 MB 00:01 2024-09-11T14:07:59.622 INFO:teuthology.orchestra.run.smithi117.stdout:(9/33): librgw2-19.3.0-4884.ge7a65bf9.el9.x86_6 12 MB/s | 5.4 MB 00:00 2024-09-11T14:07:59.648 INFO:teuthology.orchestra.run.smithi117.stdout:(10/33): python3-cephfs-19.3.0-4884.ge7a65bf9.e 547 kB/s | 160 kB 00:00 2024-09-11T14:07:59.681 INFO:teuthology.orchestra.run.smithi117.stdout:(11/33): python3-rados-19.3.0-4884.ge7a65bf9.el 2.3 MB/s | 315 kB 00:00 2024-09-11T14:07:59.707 INFO:teuthology.orchestra.run.smithi117.stdout:(12/33): python3-rgw-19.3.0-4884.ge7a65bf9.el9. 1.7 MB/s | 99 kB 00:00 2024-09-11T14:07:59.740 INFO:teuthology.orchestra.run.smithi117.stdout:(13/33): python3-rbd-19.3.0-4884.ge7a65bf9.el9. 2.5 MB/s | 303 kB 00:00 2024-09-11T14:07:59.815 INFO:teuthology.orchestra.run.smithi117.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 799 kB/s | 107 kB 00:00 2024-09-11T14:07:59.841 INFO:teuthology.orchestra.run.smithi117.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-11T14:07:59.866 INFO:teuthology.orchestra.run.smithi117.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-11T14:07:59.900 INFO:teuthology.orchestra.run.smithi117.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 539 kB/s | 45 kB 00:00 2024-09-11T14:07:59.942 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:07:59.967 INFO:teuthology.orchestra.run.smithi117.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 634 kB/s | 42 kB 00:00 2024-09-11T14:07:59.980 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:07:59.992 INFO:teuthology.orchestra.run.smithi117.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-11T14:08:00.025 INFO:teuthology.orchestra.run.smithi117.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-11T14:08:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:08:00.069 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:08:00.069 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:08:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:00.075 INFO:teuthology.orchestra.run.smithi117.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 431 kB/s | 36 kB 00:00 2024-09-11T14:08:00.101 INFO:teuthology.orchestra.run.smithi117.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-11T14:08:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:08:00.126 INFO:teuthology.orchestra.run.smithi117.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-11T14:08:00.185 INFO:teuthology.orchestra.run.smithi117.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T14:08:00.210 INFO:teuthology.orchestra.run.smithi117.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T14:08:00.235 INFO:teuthology.orchestra.run.smithi117.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 276 kB/s | 26 kB 00:00 2024-09-11T14:08:00.261 INFO:teuthology.orchestra.run.smithi117.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T14:08:00.294 INFO:teuthology.orchestra.run.smithi117.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T14:08:00.345 INFO:teuthology.orchestra.run.smithi117.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-11T14:08:00.403 INFO:teuthology.orchestra.run.smithi117.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T14:08:00.470 INFO:teuthology.orchestra.run.smithi117.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T14:08:00.596 INFO:teuthology.orchestra.run.smithi117.stdout:(32/33): librados2-19.3.0-4884.ge7a65bf9.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-11T14:08:00.672 INFO:teuthology.orchestra.run.smithi117.stdout:(33/33): librbd1-19.3.0-4884.ge7a65bf9.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-11T14:08:00.676 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:08:00.677 INFO:teuthology.orchestra.run.smithi117.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-11T14:08:00.786 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:08:00.822 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:08:00.822 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:08:01.500 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:08:01.500 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:08:03.053 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:08:03.579 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:08:03.656 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:08:03.731 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:08:03.829 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:08:03.858 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:08:03.921 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:08:03.974 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:08:04.004 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:08:04.029 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:08:04.052 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:08:04.073 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:08:04.264 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:08:04.294 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:08:04.329 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:08:04.372 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 11/35 2024-09-11T14:08:04.401 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:08:04.488 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:08:04.515 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:08:04.604 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:08:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:08:04.759 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:08:04.790 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:08:04.832 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:08:04.864 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:08:04.893 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:08:04.929 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:08:05.301 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:08:05.364 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:08:05.455 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:08:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 24/35 2024-09-11T14:08:05.530 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:08:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:08:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:08:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:08:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 28/35 2024-09-11T14:08:06.335 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 29/35 2024-09-11T14:08:08.821 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:08:08.865 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:08:09.549 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:08:09.593 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:08:09.694 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:08:09.694 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:08:09.694 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:08:09.694 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:09.728 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:08:10.611 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /sys 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /proc 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /mnt 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /var/tmp 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /home 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /root 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /tmp 2024-09-11T14:08:10.612 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:11.727 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:08:11.752 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:08:11.752 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:08:11.752 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:08:11.752 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:08:11.752 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:08:11.752 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:11.754 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:08:11.821 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:08:11.822 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:08:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:08:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 6/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 7/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 8/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 9/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 10/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 11/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 13/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:08:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:08:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:08:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:08:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:08:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:08:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:08:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:08:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:08:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/35 2024-09-11T14:08:14.003 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:08:14.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:14.003 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.004 INFO:teuthology.orchestra.run.smithi097.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:14.006 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:08:14.373 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-test 2024-09-11T14:08:14.939 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:08:15.081 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:08:15.082 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:08:15.082 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 85 M 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 175 k 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:08:15.083 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:15.084 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:08:15.084 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:08:15.084 INFO:teuthology.orchestra.run.smithi097.stdout:Install 9 Packages 2024-09-11T14:08:15.084 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:15.084 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 87 M 2024-09-11T14:08:15.084 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 797 M 2024-09-11T14:08:15.085 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:08:15.910 INFO:teuthology.orchestra.run.smithi097.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 518 kB/s | 94 kB 00:00 2024-09-11T14:08:15.952 INFO:teuthology.orchestra.run.smithi097.stdout:(2/9): libcephsqlite-19.3.0-4884.ge7a65bf9.el9. 783 kB/s | 175 kB 00:00 2024-09-11T14:08:16.077 INFO:teuthology.orchestra.run.smithi097.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.0 MB/s | 513 kB 00:00 2024-09-11T14:08:16.110 INFO:teuthology.orchestra.run.smithi097.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 183 kB 00:00 2024-09-11T14:08:16.202 INFO:teuthology.orchestra.run.smithi097.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-11T14:08:16.253 INFO:teuthology.orchestra.run.smithi097.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T14:08:16.295 INFO:teuthology.orchestra.run.smithi097.stdout:(7/9): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-11T14:08:16.337 INFO:teuthology.orchestra.run.smithi097.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.4 MB/s | 122 kB 00:00 2024-09-11T14:08:18.296 INFO:teuthology.orchestra.run.smithi097.stdout:(9/9): ceph-test-19.3.0-4884.ge7a65bf9.el9.x86_ 33 MB/s | 85 MB 00:02 2024-09-11T14:08:18.298 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:08:18.298 INFO:teuthology.orchestra.run.smithi097.stdout:Total 27 MB/s | 87 MB 00:03 2024-09-11T14:08:18.381 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:08:18.403 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:08:18.403 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:08:19.005 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:08:19.005 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:08:19.888 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:08:19.962 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:08:20.005 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:08:20.049 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:08:20.077 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:08:20.116 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:08:20.140 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:08:20.219 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-11T14:08:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:20.265 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:08:20.292 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:08:21.337 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:08:21.362 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:08:21.362 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:08:21.362 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:08:21.362 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:08:21.362 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:08:21.363 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:21.364 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:08:21.448 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:08:21.448 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:08:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:08:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/35 2024-09-11T14:08:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:08:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 6/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 7/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 8/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 9/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 10/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 11/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 13/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:08:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:08:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:08:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:08:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:08:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:08:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:08:22.772 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:08:22.772 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/35 2024-09-11T14:08:23.902 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:08:23.903 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:08:23.904 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:23.905 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:08:24.260 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-test 2024-09-11T14:08:24.826 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:29 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:08:24.965 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 85 M 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 175 k 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:08:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout:Install 9 Packages 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:24.967 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 87 M 2024-09-11T14:08:24.968 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 797 M 2024-09-11T14:08:24.968 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:08:25.970 INFO:teuthology.orchestra.run.smithi117.stdout:(1/9): libcephsqlite-19.3.0-4884.ge7a65bf9.el9. 756 kB/s | 175 kB 00:00 2024-09-11T14:08:26.228 INFO:teuthology.orchestra.run.smithi117.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 1.9 MB/s | 513 kB 00:00 2024-09-11T14:08:26.287 INFO:teuthology.orchestra.run.smithi117.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-11T14:08:26.412 INFO:teuthology.orchestra.run.smithi117.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-11T14:08:26.462 INFO:teuthology.orchestra.run.smithi117.stdout:(5/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 130 kB/s | 94 kB 00:00 2024-09-11T14:08:26.579 INFO:teuthology.orchestra.run.smithi117.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-11T14:08:26.605 INFO:teuthology.orchestra.run.smithi117.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-11T14:08:26.646 INFO:teuthology.orchestra.run.smithi117.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-11T14:08:28.172 INFO:teuthology.orchestra.run.smithi117.stdout:(9/9): ceph-test-19.3.0-4884.ge7a65bf9.el9.x86_ 35 MB/s | 85 MB 00:02 2024-09-11T14:08:28.175 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:08:28.175 INFO:teuthology.orchestra.run.smithi117.stdout:Total 27 MB/s | 87 MB 00:03 2024-09-11T14:08:28.258 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:08:28.281 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:08:28.281 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:08:28.882 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:08:28.883 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:08:29.761 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:08:29.843 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:08:29.890 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:08:29.934 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:08:29.976 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:08:30.009 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:08:30.036 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:08:30.103 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:08:30.151 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:08:30.194 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:08:31.784 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:08:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:08:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:08:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/9 2024-09-11T14:08:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/9 2024-09-11T14:08:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:08:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:08:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:08:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:08:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:08:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:08:38.389 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:08:38.389 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:38.389 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:38.390 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:08:38.757 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph 2024-09-11T14:08:39.323 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:00:53 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:08:39.457 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout: ceph x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.5 k 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 2.2 M 2024-09-11T14:08:39.460 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 1.6 M 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 291 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.1 M 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 70 M 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:08:39.461 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:08:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:08:39.463 INFO:teuthology.orchestra.run.smithi097.stdout:Install 37 Packages 2024-09-11T14:08:39.464 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:39.464 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 84 M 2024-09-11T14:08:39.464 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 896 M 2024-09-11T14:08:39.464 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:08:40.277 INFO:teuthology.orchestra.run.smithi097.stdout:(1/37): ceph-19.3.0-4884.ge7a65bf9.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-11T14:08:40.435 INFO:teuthology.orchestra.run.smithi097.stdout:(2/37): ceph-mgr-19.3.0-4884.ge7a65bf9.el9.x86_ 5.6 MB/s | 1.6 MB 00:00 2024-09-11T14:08:40.502 INFO:teuthology.orchestra.run.smithi097.stdout:(3/37): ceph-mds-19.3.0-4884.ge7a65bf9.el9.x86_ 6.2 MB/s | 2.2 MB 00:00 2024-09-11T14:08:40.594 INFO:teuthology.orchestra.run.smithi097.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4884.ge7a6 3.1 MB/s | 291 kB 00:00 2024-09-11T14:08:40.661 INFO:teuthology.orchestra.run.smithi097.stdout:(5/37): ceph-mon-19.3.0-4884.ge7a65bf9.el9.x86_ 13 MB/s | 5.1 MB 00:00 2024-09-11T14:08:40.778 INFO:teuthology.orchestra.run.smithi097.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-11T14:08:40.820 INFO:teuthology.orchestra.run.smithi097.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-11T14:08:40.870 INFO:teuthology.orchestra.run.smithi097.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-09-11T14:08:40.895 INFO:teuthology.orchestra.run.smithi097.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-11T14:08:40.921 INFO:teuthology.orchestra.run.smithi097.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-11T14:08:40.946 INFO:teuthology.orchestra.run.smithi097.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-11T14:08:41.448 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:08:41.471 INFO:teuthology.orchestra.run.smithi097.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 343 kB/s | 188 kB 00:00 2024-09-11T14:08:41.524 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:08:41.580 INFO:teuthology.orchestra.run.smithi097.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-11T14:08:41.605 INFO:teuthology.orchestra.run.smithi097.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 261 kB/s | 172 kB 00:00 2024-09-11T14:08:41.697 INFO:teuthology.orchestra.run.smithi097.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 661 kB/s | 77 kB 00:00 2024-09-11T14:08:41.723 INFO:teuthology.orchestra.run.smithi097.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-11T14:08:41.790 INFO:teuthology.orchestra.run.smithi097.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-09-11T14:08:41.815 INFO:teuthology.orchestra.run.smithi097.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 355 kB/s | 42 kB 00:00 2024-09-11T14:08:41.848 INFO:teuthology.orchestra.run.smithi097.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-11T14:08:41.874 INFO:teuthology.orchestra.run.smithi097.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 741 kB/s | 43 kB 00:00 2024-09-11T14:08:41.899 INFO:teuthology.orchestra.run.smithi097.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.5 MB/s | 172 kB 00:00 2024-09-11T14:08:41.924 INFO:teuthology.orchestra.run.smithi097.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-09-11T14:08:41.950 INFO:teuthology.orchestra.run.smithi097.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 705 kB/s | 18 kB 00:00 2024-09-11T14:08:41.975 INFO:teuthology.orchestra.run.smithi097.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 928 kB/s | 23 kB 00:00 2024-09-11T14:08:42.000 INFO:teuthology.orchestra.run.smithi097.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 781 kB/s | 19 kB 00:00 2024-09-11T14:08:42.026 INFO:teuthology.orchestra.run.smithi097.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 781 kB/s | 20 kB 00:00 2024-09-11T14:08:42.051 INFO:teuthology.orchestra.run.smithi097.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-09-11T14:08:42.077 INFO:teuthology.orchestra.run.smithi097.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-11T14:08:42.102 INFO:teuthology.orchestra.run.smithi097.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T14:08:42.127 INFO:teuthology.orchestra.run.smithi097.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-11T14:08:42.152 INFO:teuthology.orchestra.run.smithi097.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-11T14:08:42.178 INFO:teuthology.orchestra.run.smithi097.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-11T14:08:42.204 INFO:teuthology.orchestra.run.smithi097.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2024-09-11T14:08:42.228 INFO:teuthology.orchestra.run.smithi097.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T14:08:42.254 INFO:teuthology.orchestra.run.smithi097.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-11T14:08:42.846 INFO:teuthology.orchestra.run.smithi097.stdout:(36/37): ceph-osd-19.3.0-4884.ge7a65bf9.el9.x86 29 MB/s | 70 MB 00:02 2024-09-11T14:08:42.871 INFO:teuthology.orchestra.run.smithi097.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 640 kB/s | 427 kB 00:00 2024-09-11T14:08:42.875 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:08:42.875 INFO:teuthology.orchestra.run.smithi097.stdout:Total 25 MB/s | 84 MB 00:03 2024-09-11T14:08:43.024 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:08:43.065 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:08:43.065 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:08:43.865 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:08:43.865 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:08:45.540 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:08:45.607 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:08:45.639 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:08:45.667 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:08:45.742 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:08:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:08:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:08:45.903 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:08:45.981 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:08:46.030 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:08:46.065 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:08:46.095 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:08:46.129 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:08:46.163 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:08:46.204 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:08:46.247 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:08:46.306 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:08:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:08:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:08:46.468 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:08:46.615 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:08:46.695 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:08:46.748 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:08:46.786 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:08:46.835 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:08:46.890 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:08:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:08:47.141 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:08:47.228 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:08:47.318 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:08:47.359 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:08:47.488 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:08:47.529 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:08:47.529 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/9 2024-09-11T14:08:47.530 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/9 2024-09-11T14:08:47.530 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:08:47.530 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:08:47.530 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:08:47.530 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:08:47.530 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:08:47.530 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:08:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 32/37 2024-09-11T14:08:47.713 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:08:47.740 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:08:47.740 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:08:47.740 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:08:47.740 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:08:47.740 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:08:47.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:08:47.980 INFO:teuthology.orchestra.run.smithi117.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:08:47.981 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:47.981 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:08:48.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph 2024-09-11T14:08:48.891 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:53 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:08:49.030 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:08:49.032 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.5 k 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 2.2 M 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 1.6 M 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 291 k 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.1 M 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 70 M 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:08:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:08:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:08:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:08:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:08:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:08:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:49.036 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:08:49.036 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:08:49.036 INFO:teuthology.orchestra.run.smithi117.stdout:Install 37 Packages 2024-09-11T14:08:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:49.037 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 84 M 2024-09-11T14:08:49.037 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 896 M 2024-09-11T14:08:49.037 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:08:49.388 INFO:teuthology.orchestra.run.smithi117.stdout:(1/37): ceph-19.3.0-4884.ge7a65bf9.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-11T14:08:49.579 INFO:teuthology.orchestra.run.smithi117.stdout:(2/37): ceph-mgr-19.3.0-4884.ge7a65bf9.el9.x86_ 4.9 MB/s | 1.6 MB 00:00 2024-09-11T14:08:49.621 INFO:teuthology.orchestra.run.smithi117.stdout:(3/37): ceph-mds-19.3.0-4884.ge7a65bf9.el9.x86_ 6.0 MB/s | 2.2 MB 00:00 2024-09-11T14:08:49.721 INFO:teuthology.orchestra.run.smithi117.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4884.ge7a6 2.8 MB/s | 291 kB 00:00 2024-09-11T14:08:49.880 INFO:teuthology.orchestra.run.smithi117.stdout:(5/37): ceph-mon-19.3.0-4884.ge7a65bf9.el9.x86_ 10 MB/s | 5.1 MB 00:00 2024-09-11T14:08:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 920 kB/s | 253 kB 00:00 2024-09-11T14:08:50.056 INFO:teuthology.orchestra.run.smithi117.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T14:08:50.115 INFO:teuthology.orchestra.run.smithi117.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-11T14:08:50.181 INFO:teuthology.orchestra.run.smithi117.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.8 MB/s | 125 kB 00:00 2024-09-11T14:08:50.215 INFO:teuthology.orchestra.run.smithi117.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 3.7 MB/s | 1.2 MB 00:00 2024-09-11T14:08:50.249 INFO:teuthology.orchestra.run.smithi117.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-11T14:08:50.324 INFO:teuthology.orchestra.run.smithi117.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T14:08:50.349 INFO:teuthology.orchestra.run.smithi117.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-11T14:08:50.400 INFO:teuthology.orchestra.run.smithi117.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 462 kB/s | 35 kB 00:00 2024-09-11T14:08:50.425 INFO:teuthology.orchestra.run.smithi117.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-11T14:08:50.475 INFO:teuthology.orchestra.run.smithi117.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-11T14:08:50.500 INFO:teuthology.orchestra.run.smithi117.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-11T14:08:50.543 INFO:teuthology.orchestra.run.smithi117.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-11T14:08:50.568 INFO:teuthology.orchestra.run.smithi117.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-11T14:08:50.593 INFO:teuthology.orchestra.run.smithi117.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.8 MB/s | 172 kB 00:00 2024-09-11T14:08:50.610 INFO:teuthology.orchestra.run.smithi117.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-11T14:08:50.643 INFO:teuthology.orchestra.run.smithi117.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 7.0 MB/s | 358 kB 00:00 2024-09-11T14:08:50.661 INFO:teuthology.orchestra.run.smithi117.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.1 MB/s | 18 kB 00:00 2024-09-11T14:08:50.677 INFO:teuthology.orchestra.run.smithi117.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 159 kB/s | 11 kB 00:00 2024-09-11T14:08:50.694 INFO:teuthology.orchestra.run.smithi117.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 692 kB/s | 23 kB 00:00 2024-09-11T14:08:50.711 INFO:teuthology.orchestra.run.smithi117.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 581 kB/s | 19 kB 00:00 2024-09-11T14:08:50.737 INFO:teuthology.orchestra.run.smithi117.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 468 kB/s | 20 kB 00:00 2024-09-11T14:08:50.762 INFO:teuthology.orchestra.run.smithi117.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-11T14:08:50.787 INFO:teuthology.orchestra.run.smithi117.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T14:08:50.813 INFO:teuthology.orchestra.run.smithi117.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 655 kB/s | 16 kB 00:00 2024-09-11T14:08:50.838 INFO:teuthology.orchestra.run.smithi117.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-11T14:08:50.863 INFO:teuthology.orchestra.run.smithi117.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-11T14:08:50.888 INFO:teuthology.orchestra.run.smithi117.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-11T14:08:50.914 INFO:teuthology.orchestra.run.smithi117.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T14:08:50.939 INFO:teuthology.orchestra.run.smithi117.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-11T14:08:50.989 INFO:teuthology.orchestra.run.smithi117.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-11T14:08:52.098 INFO:teuthology.orchestra.run.smithi117.stdout:(37/37): ceph-osd-19.3.0-4884.ge7a65bf9.el9.x86 28 MB/s | 70 MB 00:02 2024-09-11T14:08:52.103 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:08:52.103 INFO:teuthology.orchestra.run.smithi117.stdout:Total 27 MB/s | 84 MB 00:03 2024-09-11T14:08:52.256 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:08:52.297 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:08:52.298 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:08:53.107 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:08:53.108 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:08:54.749 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:08:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:08:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:08:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:08:54.959 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:08:55.002 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:08:55.035 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:08:55.128 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:08:55.214 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:08:55.263 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:08:55.298 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:08:55.337 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:08:55.371 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:08:55.413 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:08:55.453 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:08:55.488 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:08:55.523 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:08:55.571 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:08:55.612 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:08:55.694 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:08:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:08:55.929 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:08:55.982 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:08:56.020 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:08:56.078 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:08:56.142 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:08:56.330 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:08:56.382 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:08:56.469 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:08:56.566 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:08:56.606 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:08:56.736 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:08:56.937 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 32/37 2024-09-11T14:08:56.968 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:08:56.995 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:08:56.995 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:08:56.995 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:08:56.996 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:08:56.996 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:08:56.996 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:08:58.289 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:08:58.316 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:08:58.316 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:08:58.316 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:08:58.316 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:08:58.317 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:08:58.317 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:58.864 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:08:58.888 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:08:58.888 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:08:58.888 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:08:58.889 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:08:58.889 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:08:58.889 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:59.123 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:08:59.147 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:08:59.147 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:08:59.147 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:08:59.147 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:08:59.147 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:08:59.147 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:08:59.212 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:09:05.895 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:09:05.895 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/37 2024-09-11T14:09:05.895 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/37 2024-09-11T14:09:05.895 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/37 2024-09-11T14:09:05.895 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 6/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:09:05.896 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:09:05.897 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:09:05.898 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:09:06.836 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:09:06.837 INFO:teuthology.orchestra.run.smithi097.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:09:06.838 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:09:06.839 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:09:06.840 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:09:06.840 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:09:06.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:06.840 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:07.106 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-base 2024-09-11T14:09:07.543 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:09:07.570 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:09:07.570 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:07.570 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:09:07.570 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:09:07.570 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:09:07.570 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:07.663 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:21 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:07.757 INFO:teuthology.orchestra.run.smithi097.stdout:Package ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:07.797 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:07.798 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:07.798 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:07.881 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install cephadm 2024-09-11T14:09:08.110 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:09:08.134 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:09:08.134 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:08.134 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:09:08.134 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:09:08.134 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:09:08.134 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:08.361 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:09:08.385 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:09:08.385 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:08.385 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:09:08.385 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:09:08.385 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:09:08.385 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:08.436 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:22 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:08.458 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:09:08.568 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:08.568 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:09:08.569 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:08.572 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 784 k 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 784 k 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 791 k 2024-09-11T14:09:08.573 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:08.856 INFO:teuthology.orchestra.run.smithi097.stdout:cephadm-19.3.0-4884.ge7a65bf9.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-11T14:09:08.857 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:08.857 INFO:teuthology.orchestra.run.smithi097.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-11T14:09:08.857 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:08.862 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:08.863 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:08.868 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:08.869 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:08.943 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:09.452 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:09.552 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:10.161 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:10.161 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:10.161 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:10.161 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:10.162 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:10.162 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:10.352 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:09:10.919 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:24 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:11.051 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 158 k 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 158 k 2024-09-11T14:09:11.052 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 644 k 2024-09-11T14:09:11.053 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:11.263 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-immutable-object-cache-19.3.0-4884.ge7a65b 752 kB/s | 158 kB 00:00 2024-09-11T14:09:11.264 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:11.264 INFO:teuthology.orchestra.run.smithi097.stdout:Total 746 kB/s | 158 kB 00:00 2024-09-11T14:09:11.265 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:11.274 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:11.274 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:11.333 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:11.333 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:11.482 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:11.573 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:09:11.597 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:09:11.597 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:11.598 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:09:11.598 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:12.535 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:09:12.535 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:12.535 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:12.535 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:12.535 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:12.535 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:12.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr 2024-09-11T14:09:13.381 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:27 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:13.472 INFO:teuthology.orchestra.run.smithi097.stdout:Package ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:13.514 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:13.515 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:13.516 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:13.594 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:09:14.164 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:14.297 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:14.298 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:14.298 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:09:14.298 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:14.298 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:14.298 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 14 M 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 34 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 16 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:14.299 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:14.300 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:14.300 INFO:teuthology.orchestra.run.smithi097.stdout:Install 11 Packages 2024-09-11T14:09:14.300 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:14.300 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 18 M 2024-09-11T14:09:14.300 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 155 M 2024-09-11T14:09:14.300 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:14.608 INFO:teuthology.orchestra.run.smithi097.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4884.ge7 218 kB/s | 34 kB 00:00 2024-09-11T14:09:14.633 INFO:teuthology.orchestra.run.smithi097.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4884.ge7a 90 kB/s | 16 kB 00:00 2024-09-11T14:09:14.834 INFO:teuthology.orchestra.run.smithi097.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-11T14:09:14.884 INFO:teuthology.orchestra.run.smithi097.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:09:14.909 INFO:teuthology.orchestra.run.smithi097.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/37 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/37 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/37 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/37 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/37 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 6/37 2024-09-11T14:09:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:09:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:09:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:09:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:09:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:09:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:09:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:09:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:09:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:09:14.951 INFO:teuthology.orchestra.run.smithi097.stdout:(6/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-09-11T14:09:15.002 INFO:teuthology.orchestra.run.smithi097.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.8 MB/s | 144 kB 00:00 2024-09-11T14:09:15.027 INFO:teuthology.orchestra.run.smithi097.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T14:09:15.061 INFO:teuthology.orchestra.run.smithi097.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.6 MB/s | 188 kB 00:00 2024-09-11T14:09:15.103 INFO:teuthology.orchestra.run.smithi097.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-11T14:09:15.253 INFO:teuthology.orchestra.run.smithi097.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4884.ge7a65b 18 MB/s | 14 MB 00:00 2024-09-11T14:09:15.257 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:15.257 INFO:teuthology.orchestra.run.smithi097.stdout:Total 19 MB/s | 18 MB 00:00 2024-09-11T14:09:15.287 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:15.306 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:15.306 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:15.567 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:15.568 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:15.915 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:09:15.915 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:15.915 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:15.915 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:15.915 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:15.915 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:09:15.916 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:09:15.917 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:09:15.918 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:09:15.919 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:15.920 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:16.115 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:16.193 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:09:16.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-base 2024-09-11T14:09:16.231 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:09:16.331 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:09:16.458 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:09:16.509 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:09:16.595 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:09:16.645 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:09:16.674 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:09:16.706 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 9/11 2024-09-11T14:09:16.802 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:21 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:16.899 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:16.944 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:16.945 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:09:16.945 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:17.009 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install cephadm 2024-09-11T14:09:17.584 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:22 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:17.717 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:17.718 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:17.718 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:09:17.718 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:17.718 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:17.718 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 784 k 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 784 k 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 791 k 2024-09-11T14:09:17.719 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:18.143 INFO:teuthology.orchestra.run.smithi117.stdout:cephadm-19.3.0-4884.ge7a65bf9.el9.noarch.rpm 1.8 MB/s | 784 kB 00:00 2024-09-11T14:09:18.144 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:18.144 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.8 MB/s | 784 kB 00:00 2024-09-11T14:09:18.145 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:18.150 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:18.150 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:18.156 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:18.156 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:18.230 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:18.756 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:18.831 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:19.187 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:19.456 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:19.457 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:19.630 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:09:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 10/11 2024-09-11T14:09:20.002 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:09:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:25 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:20.338 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 158 k 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 158 k 2024-09-11T14:09:20.339 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 644 k 2024-09-11T14:09:20.340 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:20.550 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-immutable-object-cache-19.3.0-4884.ge7a65b 752 kB/s | 158 kB 00:00 2024-09-11T14:09:20.551 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:20.552 INFO:teuthology.orchestra.run.smithi117.stdout:Total 746 kB/s | 158 kB 00:00 2024-09-11T14:09:20.552 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:20.561 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:20.561 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:20.618 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:09:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:09:20.859 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:20.859 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:09:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:09:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:21.736 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:21.736 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:21.903 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 1/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 2/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 3/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:09:21.904 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:09:21.905 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:09:21.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:09:22.225 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:09:22.226 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:09:22.226 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:09:22.226 INFO:teuthology.orchestra.run.smithi097.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:09:22.226 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:09:22.226 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:09:22.226 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:22.226 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:22.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:09:22.517 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:27 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:22.613 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:22.657 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:22.658 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:09:22.658 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:22.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:09:23.051 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:23.184 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:23.185 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 7.4 M 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:09:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:09:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:09:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:09:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:09:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:09:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:09:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:23.187 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:23.188 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2024-09-11T14:09:23.188 INFO:teuthology.orchestra.run.smithi097.stdout:Install 12 Packages 2024-09-11T14:09:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:23.188 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 38 M 2024-09-11T14:09:23.188 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 212 M 2024-09-11T14:09:23.188 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:23.281 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:23.412 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:23.413 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 14 M 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 34 k 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 16 k 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:09:23.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout:Install 11 Packages 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:23.415 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 18 M 2024-09-11T14:09:23.416 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 155 M 2024-09-11T14:09:23.416 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:23.501 INFO:teuthology.orchestra.run.smithi097.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-11T14:09:23.560 INFO:teuthology.orchestra.run.smithi097.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.0 MB/s | 801 kB 00:00 2024-09-11T14:09:23.627 INFO:teuthology.orchestra.run.smithi097.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-11T14:09:23.727 INFO:teuthology.orchestra.run.smithi097.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 182 kB/s | 18 kB 00:00 2024-09-11T14:09:23.811 INFO:teuthology.orchestra.run.smithi097.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 462 kB/s | 38 kB 00:00 2024-09-11T14:09:23.861 INFO:teuthology.orchestra.run.smithi097.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.9 MB/s | 3.0 MB 00:00 2024-09-11T14:09:23.928 INFO:teuthology.orchestra.run.smithi097.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-11T14:09:24.037 INFO:teuthology.orchestra.run.smithi097.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 22 MB/s | 4.9 MB 00:00 2024-09-11T14:09:24.129 INFO:teuthology.orchestra.run.smithi097.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-09-11T14:09:24.154 INFO:teuthology.orchestra.run.smithi097.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-11T14:09:24.221 INFO:teuthology.orchestra.run.smithi117.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4884.ge7a 70 kB/s | 16 kB 00:00 2024-09-11T14:09:24.238 INFO:teuthology.orchestra.run.smithi117.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4884.ge7 136 kB/s | 34 kB 00:00 2024-09-11T14:09:24.455 INFO:teuthology.orchestra.run.smithi117.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.9 MB/s | 863 kB 00:00 2024-09-11T14:09:24.505 INFO:teuthology.orchestra.run.smithi117.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:09:24.522 INFO:teuthology.orchestra.run.smithi117.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-11T14:09:24.546 INFO:teuthology.orchestra.run.smithi097.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-11T14:09:24.597 INFO:teuthology.orchestra.run.smithi117.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-11T14:09:24.631 INFO:teuthology.orchestra.run.smithi117.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-11T14:09:24.657 INFO:teuthology.orchestra.run.smithi117.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T14:09:24.682 INFO:teuthology.orchestra.run.smithi117.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-11T14:09:25.223 INFO:teuthology.orchestra.run.smithi117.stdout:(10/11): python3-protobuf-3.14.0-13.el9.noarch. 269 kB/s | 269 kB 00:01 2024-09-11T14:09:25.229 INFO:teuthology.orchestra.run.smithi097.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 4.0 MB/s | 7.4 MB 00:01 2024-09-11T14:09:25.230 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:25.231 INFO:teuthology.orchestra.run.smithi097.stdout:Total 19 MB/s | 38 MB 00:02 2024-09-11T14:09:25.588 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:25.614 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:25.614 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:25.965 INFO:teuthology.orchestra.run.smithi117.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4884.ge7a65b 7.2 MB/s | 14 MB 00:01 2024-09-11T14:09:25.969 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:25.969 INFO:teuthology.orchestra.run.smithi117.stdout:Total 7.1 MB/s | 18 MB 00:02 2024-09-11T14:09:26.002 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:26.023 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:26.023 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:26.039 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:26.039 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:26.298 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:26.298 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:26.801 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:26.848 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:26.878 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:09:26.922 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:09:26.927 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:09:26.960 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:09:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:09:27.055 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:09:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:09:27.177 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:09:27.230 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:09:27.245 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:09:27.278 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:09:27.313 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:09:27.354 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:09:27.357 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:09:27.386 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:09:27.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 9/11 2024-09-11T14:09:28.020 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:09:28.134 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:09:29.397 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:09:30.439 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:09:30.461 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:09:30.577 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 10/11 2024-09-11T14:09:30.631 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 1/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 2/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 3/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:09:32.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:09:32.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:09:32.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:09:32.830 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:09:32.830 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:32.830 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:32.831 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:33.078 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:09:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 1/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:09:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:09:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:09:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:09:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:09:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:09:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:09:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:09:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:33.520 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:33.637 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:33.769 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:33.770 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-11T14:09:33.770 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:09:33.770 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 7.4 M 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:09:33.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:09:33.772 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:33.772 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:33.772 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-11T14:09:33.772 INFO:teuthology.orchestra.run.smithi117.stdout:Install 12 Packages 2024-09-11T14:09:33.772 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:33.772 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 38 M 2024-09-11T14:09:33.772 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 212 M 2024-09-11T14:09:33.773 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:33.927 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:09:34.405 INFO:teuthology.orchestra.run.smithi117.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-48 16 MB/s | 7.4 MB 00:00 2024-09-11T14:09:34.498 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:48 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:34.513 INFO:teuthology.orchestra.run.smithi117.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-09-11T14:09:34.634 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 49 k 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:09:34.635 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout:Install 13 Packages 2024-09-11T14:09:34.636 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:34.637 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 2.2 M 2024-09-11T14:09:34.637 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 26 M 2024-09-11T14:09:34.637 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:34.772 INFO:teuthology.orchestra.run.smithi117.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-11T14:09:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:(4/12): libquadmath-11.5.0-2.el9.x86_64.rpm 212 kB/s | 191 kB 00:00 2024-09-11T14:09:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 198 kB/s | 18 kB 00:00 2024-09-11T14:09:34.972 INFO:teuthology.orchestra.run.smithi117.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 289 kB/s | 38 kB 00:00 2024-09-11T14:09:35.047 INFO:teuthology.orchestra.run.smithi117.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 27 MB/s | 4.9 MB 00:00 2024-09-11T14:09:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 300 kB/s | 26 kB 00:00 2024-09-11T14:09:35.073 INFO:teuthology.orchestra.run.smithi117.stdout:(8/12): libgfortran-11.5.0-2.el9.x86_64.rpm 706 kB/s | 801 kB 00:01 2024-09-11T14:09:35.079 INFO:teuthology.orchestra.run.smithi097.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 187 kB/s | 19 kB 00:00 2024-09-11T14:09:35.098 INFO:teuthology.orchestra.run.smithi117.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-11T14:09:35.138 INFO:teuthology.orchestra.run.smithi097.stdout:(3/13): ceph-mgr-rook-19.3.0-4884.ge7a65bf9.el9 306 kB/s | 49 kB 00:00 2024-09-11T14:09:35.190 INFO:teuthology.orchestra.run.smithi117.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-11T14:09:35.196 INFO:teuthology.orchestra.run.smithi097.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-11T14:09:35.221 INFO:teuthology.orchestra.run.smithi097.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-11T14:09:35.255 INFO:teuthology.orchestra.run.smithi097.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 913 kB/s | 54 kB 00:00 2024-09-11T14:09:35.257 INFO:teuthology.orchestra.run.smithi117.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.3 MB/s | 250 kB 00:00 2024-09-11T14:09:35.289 INFO:teuthology.orchestra.run.smithi097.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-11T14:09:35.314 INFO:teuthology.orchestra.run.smithi097.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 248 kB/s | 14 kB 00:00 2024-09-11T14:09:35.339 INFO:teuthology.orchestra.run.smithi097.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-11T14:09:35.373 INFO:teuthology.orchestra.run.smithi097.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-11T14:09:35.398 INFO:teuthology.orchestra.run.smithi097.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-11T14:09:35.425 INFO:teuthology.orchestra.run.smithi097.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 704 kB/s | 59 kB 00:00 2024-09-11T14:09:35.457 INFO:teuthology.orchestra.run.smithi097.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-11T14:09:35.460 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:35.461 INFO:teuthology.orchestra.run.smithi097.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-11T14:09:35.482 INFO:teuthology.orchestra.run.smithi117.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-11T14:09:35.483 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:35.483 INFO:teuthology.orchestra.run.smithi117.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-11T14:09:35.522 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:35.537 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:35.537 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:35.625 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:35.625 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:35.832 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:35.859 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:35.859 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:36.145 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:36.278 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:36.278 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:09:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:09:36.422 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:09:36.580 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:09:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:09:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:09:36.829 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:09:36.877 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:09:37.046 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:37.109 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:09:37.155 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:09:37.265 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:09:37.307 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:09:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:09:37.522 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:09:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:09:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:09:37.658 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:09:37.692 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:09:37.740 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:09:37.762 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:09:38.292 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:09:38.427 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:09:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:09:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/13 2024-09-11T14:09:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:09:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:09:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:09:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:09:38.816 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:09:38.816 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:38.816 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:38.816 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:38.816 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:09:38.816 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:09:38.816 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:38.817 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:39.070 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:09:39.637 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:53 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:09:39.770 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:39.770 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 154 k 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:39.771 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:39.772 INFO:teuthology.orchestra.run.smithi097.stdout:Install 6 Packages 2024-09-11T14:09:39.772 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:39.772 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 7.0 M 2024-09-11T14:09:39.772 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 33 M 2024-09-11T14:09:39.772 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:40.159 INFO:teuthology.orchestra.run.smithi097.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-11T14:09:40.193 INFO:teuthology.orchestra.run.smithi097.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4884.ge7a65bf9.e 648 kB/s | 154 kB 00:00 2024-09-11T14:09:40.236 INFO:teuthology.orchestra.run.smithi097.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-11T14:09:40.260 INFO:teuthology.orchestra.run.smithi097.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-11T14:09:40.285 INFO:teuthology.orchestra.run.smithi097.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 638 kB/s | 58 kB 00:00 2024-09-11T14:09:40.712 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:09:40.738 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:09:42.169 INFO:teuthology.orchestra.run.smithi097.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.7 MB/s | 6.0 MB 00:02 2024-09-11T14:09:42.172 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:42.172 INFO:teuthology.orchestra.run.smithi097.stdout:Total 2.9 MB/s | 7.0 MB 00:02 2024-09-11T14:09:42.242 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:42.254 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:42.254 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:42.354 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:42.355 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:42.657 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:09:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:09:43.383 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:09:43.420 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:09:43.420 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 1/12 2024-09-11T14:09:43.420 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:09:43.420 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:09:43.421 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:09:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:09:43.540 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:09:43.566 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:09:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:43.831 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:44.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:09:44.336 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:09:44.336 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/6 2024-09-11T14:09:44.336 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:09:44.336 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:09:44.337 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:09:44.337 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:09:44.605 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:09:44.605 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:44.605 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:44.605 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:44.605 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:09:44.606 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:09:44.606 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:09:44.606 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:09:44.606 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:09:44.606 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:44.606 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:44.777 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:49 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:44.876 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-fuse 2024-09-11T14:09:44.910 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:44.911 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 49 k 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:09:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout:Install 13 Packages 2024-09-11T14:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:44.914 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 2.2 M 2024-09-11T14:09:44.914 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 26 M 2024-09-11T14:09:44.914 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:45.405 INFO:teuthology.orchestra.run.smithi117.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 186 kB/s | 19 kB 00:00 2024-09-11T14:09:45.422 INFO:teuthology.orchestra.run.smithi117.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 214 kB/s | 26 kB 00:00 2024-09-11T14:09:45.440 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:01:59 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:45.514 INFO:teuthology.orchestra.run.smithi117.stdout:(3/13): ceph-mgr-rook-19.3.0-4884.ge7a65bf9.el9 232 kB/s | 49 kB 00:00 2024-09-11T14:09:45.539 INFO:teuthology.orchestra.run.smithi117.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-11T14:09:45.564 INFO:teuthology.orchestra.run.smithi117.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-11T14:09:45.574 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:45.575 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:45.575 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:09:45.575 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:45.575 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:45.575 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 883 k 2024-09-11T14:09:45.575 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-11T14:09:45.576 INFO:teuthology.orchestra.run.smithi097.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:09:45.576 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:45.576 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:45.576 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:45.576 INFO:teuthology.orchestra.run.smithi097.stdout:Install 2 Packages 2024-09-11T14:09:45.576 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:45.576 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 962 k 2024-09-11T14:09:45.577 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 4.1 M 2024-09-11T14:09:45.577 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:45.606 INFO:teuthology.orchestra.run.smithi117.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 778 kB/s | 32 kB 00:00 2024-09-11T14:09:45.631 INFO:teuthology.orchestra.run.smithi117.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 803 kB/s | 54 kB 00:00 2024-09-11T14:09:45.657 INFO:teuthology.orchestra.run.smithi117.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 280 kB/s | 14 kB 00:00 2024-09-11T14:09:45.707 INFO:teuthology.orchestra.run.smithi117.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 24 MB/s | 1.0 MB 00:00 2024-09-11T14:09:45.733 INFO:teuthology.orchestra.run.smithi117.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T14:09:45.758 INFO:teuthology.orchestra.run.smithi117.stdout:(11/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-09-11T14:09:45.780 INFO:teuthology.orchestra.run.smithi097.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 525 kB/s | 80 kB 00:00 2024-09-11T14:09:45.783 INFO:teuthology.orchestra.run.smithi117.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.4 MB/s | 220 kB 00:00 2024-09-11T14:09:45.808 INFO:teuthology.orchestra.run.smithi117.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-11T14:09:45.810 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:45.810 INFO:teuthology.orchestra.run.smithi117.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-11T14:09:45.875 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:45.892 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:45.892 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:45.921 INFO:teuthology.orchestra.run.smithi097.stdout:(2/2): ceph-fuse-19.3.0-4884.ge7a65bf9.el9.x86_ 2.9 MB/s | 883 kB 00:00 2024-09-11T14:09:45.922 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:45.922 INFO:teuthology.orchestra.run.smithi097.stdout:Total 2.7 MB/s | 962 kB 00:00 2024-09-11T14:09:45.934 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:45.957 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:45.958 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:45.980 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:45.980 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:46.038 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:46.039 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:46.228 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:09:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:09:46.501 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:46.671 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:09:46.726 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:09:46.781 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:09:46.818 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:09:46.860 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:09:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:09:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:09:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/2 2024-09-11T14:09:47.143 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:09:47.220 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:09:47.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:09:47.406 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:47.406 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:47.406 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:09:47.406 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:47.406 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:47.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-volume 2024-09-11T14:09:47.932 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:09:47.975 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:09:48.009 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:09:48.057 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:09:48.079 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:09:48.257 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:02 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:48.394 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:48.395 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:48.395 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-11T14:09:48.395 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:48.395 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:48.395 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 285 k 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 285 k 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 1.3 M 2024-09-11T14:09:48.396 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:48.718 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-volume-19.3.0-4884.ge7a65bf9.el9.noarch.rp 885 kB/s | 285 kB 00:00 2024-09-11T14:09:48.719 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:48.719 INFO:teuthology.orchestra.run.smithi097.stdout:Total 882 kB/s | 285 kB 00:00 2024-09-11T14:09:48.719 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:48.724 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:09:48.724 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/13 2024-09-11T14:09:48.724 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:09:48.725 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:09:48.728 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:48.729 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:48.756 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:48.757 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:49.062 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:49.062 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:09:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:09:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:49.075 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:09:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:09:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:49.076 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:49.323 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:09:49.919 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:54 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:50.061 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:50.061 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:50.062 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:09:50.062 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:50.062 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:50.062 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 154 k 2024-09-11T14:09:50.062 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:09:50.062 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:09:50.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:09:50.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:09:50.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:09:50.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:09:50.063 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:50.063 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:50.063 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:50.064 INFO:teuthology.orchestra.run.smithi117.stdout:Install 6 Packages 2024-09-11T14:09:50.064 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:50.065 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 7.0 M 2024-09-11T14:09:50.065 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 33 M 2024-09-11T14:09:50.066 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:50.070 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:50.070 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:50.071 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:50.071 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:50.071 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:50.071 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:50.285 INFO:teuthology.orchestra.run.smithi117.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-09-11T14:09:50.344 INFO:teuthology.orchestra.run.smithi117.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-11T14:09:50.348 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install librados-devel 2024-09-11T14:09:50.372 INFO:teuthology.orchestra.run.smithi117.stdout:(3/6): ceph-mgr-cephadm-19.3.0-4884.ge7a65bf9.e 655 kB/s | 154 kB 00:00 2024-09-11T14:09:50.394 INFO:teuthology.orchestra.run.smithi117.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T14:09:50.436 INFO:teuthology.orchestra.run.smithi117.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-11T14:09:50.520 INFO:teuthology.orchestra.run.smithi117.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-11T14:09:50.522 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:50.522 INFO:teuthology.orchestra.run.smithi117.stdout:Total 15 MB/s | 7.0 MB 00:00 2024-09-11T14:09:50.595 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:50.606 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:50.607 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:50.708 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:50.710 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:50.923 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:04 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:51.045 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:51.058 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:51.058 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:51.058 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 125 k 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 125 k 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 445 k 2024-09-11T14:09:51.059 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:51.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:09:51.255 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:09:51.265 INFO:teuthology.orchestra.run.smithi097.stdout:librados-devel-19.3.0-4884.ge7a65bf9.el9.x86_64 605 kB/s | 125 kB 00:00 2024-09-11T14:09:51.266 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:51.266 INFO:teuthology.orchestra.run.smithi097.stdout:Total 600 kB/s | 125 kB 00:00 2024-09-11T14:09:51.267 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:51.272 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:51.272 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:51.337 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:51.338 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:51.492 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:51.589 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:09:51.769 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:09:51.859 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:09:51.925 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:09:51.959 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:09:52.033 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:09:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:09:52.309 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:52.309 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:52.309 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:52.540 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install libcephfs2 2024-09-11T14:09:52.745 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:09:52.746 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/6 2024-09-11T14:09:52.746 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:09:52.746 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:09:52.746 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:09:52.746 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:09:53.025 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:09:53.025 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:53.025 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:53.025 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:53.025 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:09:53.025 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:09:53.025 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:09:53.026 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:09:53.026 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:09:53.026 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:53.026 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:53.118 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:07 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:53.208 INFO:teuthology.orchestra.run.smithi097.stdout:Package libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:53.254 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:53.255 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:53.255 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:53.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-fuse 2024-09-11T14:09:53.329 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install libcephfs-devel 2024-09-11T14:09:53.849 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:58 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:53.889 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:07 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:53.983 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:53.983 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:53.983 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:09:53.983 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 883 k 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout:Install 2 Packages 2024-09-11T14:09:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:53.985 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 962 k 2024-09-11T14:09:53.985 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 4.1 M 2024-09-11T14:09:53.985 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:54.021 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:54.021 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:54.021 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 32 k 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 32 k 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 142 k 2024-09-11T14:09:54.022 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:09:54.146 INFO:teuthology.orchestra.run.smithi117.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 573 kB/s | 80 kB 00:00 2024-09-11T14:09:54.236 INFO:teuthology.orchestra.run.smithi097.stdout:libcephfs-devel-19.3.0-4884.ge7a65bf9.el9.x86_6 148 kB/s | 32 kB 00:00 2024-09-11T14:09:54.237 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:54.237 INFO:teuthology.orchestra.run.smithi097.stdout:Total 147 kB/s | 32 kB 00:00 2024-09-11T14:09:54.237 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:09:54.241 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:09:54.241 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:09:54.252 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:09:54.253 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:09:54.340 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:09:54.447 INFO:teuthology.orchestra.run.smithi117.stdout:(2/2): ceph-fuse-19.3.0-4884.ge7a65bf9.el9.x86_ 2.0 MB/s | 883 kB 00:00 2024-09-11T14:09:54.447 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:54.447 INFO:teuthology.orchestra.run.smithi117.stdout:Total 2.0 MB/s | 962 kB 00:00 2024-09-11T14:09:54.459 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:09:54.459 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:54.483 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:54.483 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:54.564 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:54.564 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:54.753 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:54.827 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:09:54.900 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:09:54.979 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:09:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:09:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:55.061 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:09:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:09:55.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:09:55.061 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:55.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install librados2 2024-09-11T14:09:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:09:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/2 2024-09-11T14:09:55.810 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:09 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:55.899 INFO:teuthology.orchestra.run.smithi097.stdout:Package librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:55.943 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:55.944 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:55.944 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:55.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:09:55.970 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:55.971 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:55.971 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:09:55.971 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:55.971 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:56.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install librbd1 2024-09-11T14:09:56.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-volume 2024-09-11T14:09:56.578 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:10 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:56.669 INFO:teuthology.orchestra.run.smithi097.stdout:Package librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:56.712 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:56.713 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:56.713 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:56.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-rados 2024-09-11T14:09:56.826 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:01 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:56.964 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:56.965 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:56.965 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 285 k 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 285 k 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 1.3 M 2024-09-11T14:09:56.966 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:57.318 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-volume-19.3.0-4884.ge7a65bf9.el9.noarch.rp 811 kB/s | 285 kB 00:00 2024-09-11T14:09:57.319 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:57.319 INFO:teuthology.orchestra.run.smithi117.stdout:Total 806 kB/s | 285 kB 00:00 2024-09-11T14:09:57.319 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:57.327 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:57.327 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:57.357 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:57.357 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:09:57.361 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:57.452 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:57.496 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:57.496 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:57.497 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:57.579 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:09:57.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-rgw 2024-09-11T14:09:57.653 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:57.669 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:57.670 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:09:57.670 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:09:57.670 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:58.139 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:12 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:58.229 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:58.273 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:58.274 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:58.274 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:58.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-cephfs 2024-09-11T14:09:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:09:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:58.650 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:09:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:09:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:58.650 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:09:58.921 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:12 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:58.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados-devel 2024-09-11T14:09:59.012 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:59.055 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:59.056 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:59.056 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:59.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install python3-rbd 2024-09-11T14:09:59.554 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:04 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:09:59.690 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 125 k 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:09:59.691 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 125 k 2024-09-11T14:09:59.692 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 445 k 2024-09-11T14:09:59.692 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:09:59.695 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:13 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:09:59.786 INFO:teuthology.orchestra.run.smithi097.stdout:Package python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:09:59.830 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:09:59.831 INFO:teuthology.orchestra.run.smithi097.stdout:Nothing to do. 2024-09-11T14:09:59.831 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:09:59.906 INFO:teuthology.orchestra.run.smithi117.stdout:librados-devel-19.3.0-4884.ge7a65bf9.el9.x86_64 580 kB/s | 125 kB 00:00 2024-09-11T14:09:59.907 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:09:59.907 INFO:teuthology.orchestra.run.smithi117.stdout:Total 576 kB/s | 125 kB 00:00 2024-09-11T14:09:59.907 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:09:59.912 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install rbd-fuse 2024-09-11T14:09:59.913 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:09:59.913 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:09:59.976 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:09:59.976 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:10:00.129 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:10:00.237 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:00.473 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:10:00.606 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 91 k 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:00.607 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:10:00.608 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:00.608 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 91 k 2024-09-11T14:10:00.608 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 321 k 2024-09-11T14:10:00.608 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:10:00.683 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:00.806 INFO:teuthology.orchestra.run.smithi097.stdout:rbd-fuse-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 458 kB/s | 91 kB 00:00 2024-09-11T14:10:00.807 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:00.807 INFO:teuthology.orchestra.run.smithi097.stdout:Total 455 kB/s | 91 kB 00:00 2024-09-11T14:10:00.807 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:10:00.815 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:10:00.816 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:10:00.880 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:10:00.880 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:10:00.955 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:00.955 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:00.955 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:10:00.955 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:00.955 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:00.955 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:01.018 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:10:01.111 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:01.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs2 2024-09-11T14:10:01.480 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:01.736 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:01.736 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:01.736 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:10:01.737 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:01.737 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:01.737 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:10:01.759 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:06 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:01.850 INFO:teuthology.orchestra.run.smithi117.stdout:Package libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:01.895 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:01.896 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:10:01.896 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:01.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs-devel 2024-09-11T14:10:02.043 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install rbd-mirror 2024-09-11T14:10:02.545 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:07 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:02.626 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:16 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:10:02.678 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:02.679 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:02.679 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-11T14:10:02.679 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:02.679 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:10:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 32 k 2024-09-11T14:10:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:02.680 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:10:02.680 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:02.680 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:10:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:02.681 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 32 k 2024-09-11T14:10:02.681 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 142 k 2024-09-11T14:10:02.681 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:10:02.764 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:10:02.764 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repo Size 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:02.765 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 3.5 M 2024-09-11T14:10:02.766 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 30 M 2024-09-11T14:10:02.766 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:10:02.835 INFO:teuthology.orchestra.run.smithi117.stdout:libcephfs-devel-19.3.0-4884.ge7a65bf9.el9.x86_6 204 kB/s | 32 kB 00:00 2024-09-11T14:10:02.836 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:02.836 INFO:teuthology.orchestra.run.smithi117.stdout:Total 202 kB/s | 32 kB 00:00 2024-09-11T14:10:02.836 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:10:02.839 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:10:02.840 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:10:02.857 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:10:02.857 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:10:02.964 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:10:03.074 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:03.102 INFO:teuthology.orchestra.run.smithi097.stdout:rbd-mirror-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-11T14:10:03.102 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:03.103 INFO:teuthology.orchestra.run.smithi097.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-11T14:10:03.103 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:10:03.114 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:10:03.114 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:10:03.198 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:10:03.198 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:10:03.455 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:03.689 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:03.689 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:03.689 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:10:03.689 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:03.689 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:03.689 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:03.781 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:10:03.844 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:03.870 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:03.870 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:10:03.871 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:10:03.871 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:10:03.871 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:10:03.871 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:03.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados2 2024-09-11T14:10:04.441 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:09 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:04.531 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:04.574 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:04.575 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:10:04.575 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:04.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librbd1 2024-09-11T14:10:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:05.109 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:10:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:05.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:05.109 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:10:05.196 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:10 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:05.287 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:05.331 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:05.332 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:10:05.332 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:05.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install rbd-nbd 2024-09-11T14:10:05.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rados 2024-09-11T14:10:05.945 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:02:19 ago on Wed 11 Sep 2024 02:07:46 PM UTC. 2024-09-11T14:10:05.963 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:10 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:06.052 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:06.081 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-11T14:10:06.081 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 177 k 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 177 k 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 685 k 2024-09-11T14:10:06.082 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-11T14:10:06.095 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:06.097 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:10:06.097 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:06.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rgw 2024-09-11T14:10:06.281 INFO:teuthology.orchestra.run.smithi097.stdout:rbd-nbd-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 893 kB/s | 177 kB 00:00 2024-09-11T14:10:06.281 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:06.281 INFO:teuthology.orchestra.run.smithi097.stdout:Total 885 kB/s | 177 kB 00:00 2024-09-11T14:10:06.282 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-11T14:10:06.291 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-11T14:10:06.292 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-11T14:10:06.357 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-11T14:10:06.357 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-11T14:10:06.513 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-11T14:10:06.612 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:06.718 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:06.808 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:06.852 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:06.853 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:10:06.853 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:06.933 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-cephfs 2024-09-11T14:10:07.067 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:07.351 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:07.351 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:07.351 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-11T14:10:07.351 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:07.351 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:07.351 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-11T14:10:07.498 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:12 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:07.614 DEBUG:teuthology.parallel:result is None 2024-09-11T14:10:07.633 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:07.634 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:10:07.634 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:07.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rbd 2024-09-11T14:10:08.254 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:13 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:08.346 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:10:08.389 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:08.391 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-11T14:10:08.392 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:08.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-fuse 2024-09-11T14:10:09.002 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:09.136 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:09.136 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:09.136 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 91 k 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 91 k 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 321 k 2024-09-11T14:10:09.137 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:10:09.512 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-fuse-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 242 kB/s | 91 kB 00:00 2024-09-11T14:10:09.513 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:09.513 INFO:teuthology.orchestra.run.smithi117.stdout:Total 241 kB/s | 91 kB 00:00 2024-09-11T14:10:09.513 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:10:09.523 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:10:09.523 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:10:09.587 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:10:09.588 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:10:09.734 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:10:09.844 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:10.253 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:10.554 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:10:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:10.555 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:10.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-mirror 2024-09-11T14:10:11.407 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:16 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:11.545 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 3.5 M 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 30 M 2024-09-11T14:10:11.546 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:10:12.300 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-mirror-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 4.7 MB/s | 3.5 MB 00:00 2024-09-11T14:10:12.300 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:12.301 INFO:teuthology.orchestra.run.smithi117.stdout:Total 4.6 MB/s | 3.5 MB 00:00 2024-09-11T14:10:12.301 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:10:12.312 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:10:12.312 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:10:12.396 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:10:12.396 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:10:12.978 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:10:13.034 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:13.060 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:13.060 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:10:13.060 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:10:13.060 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:10:13.060 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:10:13.060 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:14.276 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:10:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:14.276 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:14.276 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:14.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-nbd 2024-09-11T14:10:15.076 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:07:55 PM UTC. 2024-09-11T14:10:15.212 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 177 k 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 177 k 2024-09-11T14:10:15.213 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 685 k 2024-09-11T14:10:15.214 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T14:10:15.420 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-nbd-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 857 kB/s | 177 kB 00:00 2024-09-11T14:10:15.420 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:10:15.421 INFO:teuthology.orchestra.run.smithi117.stdout:Total 851 kB/s | 177 kB 00:00 2024-09-11T14:10:15.421 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T14:10:15.430 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T14:10:15.430 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T14:10:15.494 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T14:10:15.494 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T14:10:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T14:10:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:16.158 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:10:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:16.412 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T14:10:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:10:16.412 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:16.412 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T14:10:16.652 DEBUG:teuthology.parallel:result is None 2024-09-11T14:10:16.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:10:16.802 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:10:16.829 INFO:teuthology.orchestra.run.smithi097.stdout:19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:10:16.830 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:10:16.830 INFO:teuthology.task.install:The correct ceph version 19.3.0-4884.ge7a65bf9 is installed. 2024-09-11T14:10:16.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:10:16.975 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:10:17.001 INFO:teuthology.orchestra.run.smithi117.stdout:19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:10:17.001 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:10:17.001 INFO:teuthology.task.install:The correct ceph version 19.3.0-4884.ge7a65bf9 is installed. 2024-09-11T14:10:17.003 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T14:10:17.003 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:17.003 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:10:17.035 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:17.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:10:17.067 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T14:10:17.067 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:17.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:10:17.104 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:10:17.174 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:17.174 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:10:17.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:10:17.265 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T14:10:17.265 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:17.265 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:10:17.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:10:17.361 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:17.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:10:17.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:10:17.451 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T14:10:17.452 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:17.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:10:17.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:10:17.545 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:17.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:10:17.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:10:17.635 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T14:10:17.733 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T14:10:17.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-09-11T14:10:17.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-09-11T14:10:17.762 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T14:10:17.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:10:17.804 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:10:17.829 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T14:10:17.829 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:10:17.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:10:17.903 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T14:10:17.903 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T14:10:17.904 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306', 'branch': 'wip-matanb-crimson-testing-sep11', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7901306', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-sep11'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2853, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOkLc/dPfK+VVTmm03SbPZn9jQcplhId/YPxp8TCojEFJUMrai8JgDRvIQmae+PavDkfLDsndsfyOVPk9OfzE/k=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPO3pxWzuFuif+h4uCCgMOGRNx4HT21O/9n0xO/9e3Gvh94f+JXNwHTzKUSsWsL60Xpdsou19j0uHOwJHcRdZ0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_13:53:46', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T14:10:17.904 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:10:17.936 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:10:17.951 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:10:17.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:10:18.017 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:18.017 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:10:18.071 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:10:18.071 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-09-11T14:10:18.126 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:10:18.126 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:18.126 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T14:10:18.126 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:18.126 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:18.127 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-11 14:10:04.116663277 +0000 2024-09-11T14:10:18.127 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-11 14:07:03.973680774 +0000 2024-09-11T14:10:18.127 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-11 14:07:03.973680774 +0000 2024-09-11T14:10:18.127 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-11 14:07:03.973680774 +0000 2024-09-11T14:10:18.127 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:10:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-11T14:10:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-11T14:10:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000204316 s, 2.5 MB/s 2024-09-11T14:10:18.190 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:10:18.248 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-09-11T14:10:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-11 14:10:04.117663260 +0000 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-11 14:07:04.297675252 +0000 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-11 14:07:04.297675252 +0000 2024-09-11T14:10:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-11 14:07:04.297675252 +0000 2024-09-11T14:10:18.304 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:10:18.367 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-11T14:10:18.367 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-11T14:10:18.367 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000176994 s, 2.9 MB/s 2024-09-11T14:10:18.368 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:10:18.424 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-11 14:10:04.117663260 +0000 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-11 14:07:04.626669647 +0000 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-11 14:07:04.626669647 +0000 2024-09-11T14:10:18.480 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-11 14:07:04.626669647 +0000 2024-09-11T14:10:18.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:10:18.543 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-11T14:10:18.543 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-11T14:10:18.543 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000223646 s, 2.3 MB/s 2024-09-11T14:10:18.544 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:10:18.600 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-09-11T14:10:18.655 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-11 14:10:04.117663260 +0000 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-11 14:07:04.950664127 +0000 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-11 14:07:04.950664127 +0000 2024-09-11T14:10:18.656 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-11 14:07:04.950664127 +0000 2024-09-11T14:10:18.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:10:18.719 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-11T14:10:18.719 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-11T14:10:18.719 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00022075 s, 2.3 MB/s 2024-09-11T14:10:18.720 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:10:18.776 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:10:18.777 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:18.777 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:10:18.793 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:10:18.793 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 14:10:13.319980626 +0000 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 14:07:03.991269146 +0000 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 14:07:03.991269146 +0000 2024-09-11T14:10:18.849 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 14:07:03.991269146 +0000 2024-09-11T14:10:18.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:10:18.913 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T14:10:18.914 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T14:10:18.914 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000489661 s, 1.0 MB/s 2024-09-11T14:10:18.915 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:10:18.971 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-11T14:10:19.026 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 14:10:13.319980626 +0000 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 14:07:04.331262749 +0000 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 14:07:04.331262749 +0000 2024-09-11T14:10:19.027 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 14:07:04.331262749 +0000 2024-09-11T14:10:19.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:10:19.090 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T14:10:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T14:10:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000201595 s, 2.5 MB/s 2024-09-11T14:10:19.092 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:10:19.148 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-11T14:10:19.203 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:10:19.203 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:19.203 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T14:10:19.203 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:19.203 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:19.203 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 14:10:13.319980626 +0000 2024-09-11T14:10:19.204 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 14:07:04.653256691 +0000 2024-09-11T14:10:19.204 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 14:07:04.653256691 +0000 2024-09-11T14:10:19.204 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 14:07:04.653256691 +0000 2024-09-11T14:10:19.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:10:19.266 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T14:10:19.266 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T14:10:19.267 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000240813 s, 2.1 MB/s 2024-09-11T14:10:19.268 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:10:19.324 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-11T14:10:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:10:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:10:19.380 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T14:10:19.380 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:10:19.380 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:10:19.380 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 14:10:13.320980607 +0000 2024-09-11T14:10:19.381 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 14:07:04.966250802 +0000 2024-09-11T14:10:19.381 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 14:07:04.966250802 +0000 2024-09-11T14:10:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 14:07:04.966250802 +0000 2024-09-11T14:10:19.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:10:19.443 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T14:10:19.443 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T14:10:19.443 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000167975 s, 3.0 MB/s 2024-09-11T14:10:19.445 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:10:19.501 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:10:19.501 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:10:19.502 INFO:tasks.ceph:Generating config... 2024-09-11T14:10:19.504 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-11T14:10:19.504 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-11T14:10:19.504 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-11T14:10:19.504 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-11T14:10:19.504 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-11T14:10:19.505 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T14:10:19.505 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T14:10:19.506 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T14:10:19.506 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T14:10:19.506 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-11T14:10:19.506 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-11T14:10:19.506 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T14:10:19.506 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-11T14:10:19.506 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T14:10:19.507 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] log to file = False 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T14:10:19.508 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T14:10:19.509 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T14:10:19.509 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:10:19.509 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-11T14:10:19.509 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-11T14:10:19.509 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-11T14:10:19.509 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-11T14:10:19.509 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-11T14:10:19.509 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-11T14:10:19.509 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T14:10:19.510 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T14:10:19.510 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-11T14:10:19.510 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-11T14:10:19.510 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-11T14:10:19.510 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-11T14:10:19.510 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-11T14:10:19.510 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T14:10:19.510 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T14:10:19.597 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T14:10:19.602 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T14:10:19.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:10:19.680 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97')] 2024-09-11T14:10:19.681 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-11T14:10:19.682 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:19.682 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:10:19.735 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:19.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:19.824+0000 7ff2add1ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:19.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:19.825+0000 7ff2add1ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:19.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:19.825+0000 7ff2add1ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid f3855fa8-d59d-46b3-8802-359d51f9681f 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = quincy 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:fsid f3855fa8-d59d-46b3-8802-359d51f9681f 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2024-09-11T14:10:19.826345+0000 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:created 2024-09-11T14:10:19.826345+0000 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 17 (quincy) 2024-09-11T14:10:19.827 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2024-09-11T14:10:19.828 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-11T14:10:19.828 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-11T14:10:19.829 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:10:19.844 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f3855fa8-d59d-46b3-8802-359d51f9681f... 2024-09-11T14:10:19.846 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:10:19.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:10:19.929 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-11T14:10:19.929 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-11T14:10:19.929 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:10:19.929 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-11T14:10:19.929 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.930 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:10:19.931 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-11T14:10:19.932 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = 172.21.15.97 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: ms client mode = crc 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: ms cluster mode = crc 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: ms mon client mode = crc 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: ms mon cluster mode = crc 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: ms mon service mode = crc 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: ms service mode = crc 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = f3855fa8-d59d-46b3-8802-359d51f9681f 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.933 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-09-11T14:10:19.934 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-11T14:10:19.935 INFO:teuthology.orchestra.run.smithi097.stdout: debug monc = 20 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore compression algorithm = snappy 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore compression mode = aggressive 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore rocksdb cf = False 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: crimson osd obc lru size = 10 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 20 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 20 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 10 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: err to stderr = True 2024-09-11T14:10:19.936 INFO:teuthology.orchestra.run.smithi097.stdout: log flush on exit = True 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: log to file = False 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: log to stderr = True 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: osd class default list = * 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: osd class load list = * 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: osd shutdown pgref assert = True 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-11T14:10:19.937 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: mgr stats period = 30 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-11T14:10:19.938 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-11T14:10:19.939 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: mon min osdmap epochs = 50 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: mon osdmap full prune interval = 2 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: mon osdmap full prune min = 15 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: paxos service trim min = 10 2024-09-11T14:10:19.940 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on pool no app = False 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default crimson = True 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:10:19.941 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-09-11T14:10:19.942 INFO:teuthology.orchestra.run.smithi097.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-09-11T14:10:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:10:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:10:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-09-11T14:10:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = 172.21.15.97 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: ms client mode = crc 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: ms cluster mode = crc 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: ms mon client mode = crc 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: ms mon cluster mode = crc 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: ms mon service mode = crc 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: ms service mode = crc 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = f3855fa8-d59d-46b3-8802-359d51f9681f 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-09-11T14:10:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-09-11T14:10:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-09-11T14:10:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-09-11T14:10:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:10:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-09-11T14:10:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: debug monc = 20 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-09-11T14:10:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore compression algorithm = snappy 2024-09-11T14:10:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore compression mode = aggressive 2024-09-11T14:10:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-09-11T14:10:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore rocksdb cf = False 2024-09-11T14:10:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:10:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: crimson osd obc lru size = 10 2024-09-11T14:10:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-09-11T14:10:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-09-11T14:10:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-11T14:10:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-09-11T14:10:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-09-11T14:10:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: err to stderr = True 2024-09-11T14:10:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: log flush on exit = True 2024-09-11T14:10:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: log to file = False 2024-09-11T14:10:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: log to stderr = True 2024-09-11T14:10:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T14:10:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-09-11T14:10:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-09-11T14:10:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:10:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd class default list = * 2024-09-11T14:10:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd class load list = * 2024-09-11T14:10:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-09-11T14:10:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-09-11T14:10:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd shutdown pgref assert = True 2024-09-11T14:10:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.957 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-09-11T14:10:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-11T14:10:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-09-11T14:10:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-11T14:10:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-11T14:10:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:10:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:10:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-09-11T14:10:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: mgr stats period = 30 2024-09-11T14:10:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.958 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-09-11T14:10:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-11T14:10:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-11T14:10:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-09-11T14:10:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-11T14:10:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-09-11T14:10:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-09-11T14:10:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:10:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-09-11T14:10:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-09-11T14:10:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:10:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:10:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:10:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:10:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:10:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:10:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:10:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon min osdmap epochs = 50 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon osdmap full prune interval = 2 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon osdmap full prune min = 15 2024-09-11T14:10:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:10:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: paxos service trim min = 10 2024-09-11T14:10:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on pool no app = False 2024-09-11T14:10:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default crimson = True 2024-09-11T14:10:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T14:10:19.963 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-09-11T14:10:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-09-11T14:10:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-09-11T14:10:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-09-11T14:10:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:10:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:10:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-11T14:10:19.964 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-09-11T14:10:19.964 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-09-11T14:10:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:10:19.965 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-09-11T14:10:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:10:19.965 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-09-11T14:10:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:10:19.965 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-09-11T14:10:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:10:19.966 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T14:10:19.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T14:10:20.048 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T14:10:20.048 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:20.049 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T14:10:20.065 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:20.065 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T14:10:20.119 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-09-11T14:10:20.119 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:20.119 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:10:20.119 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:10:20.193 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:20.193 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:20.249 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T14:10:20.250 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:20.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:10:20.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:10:20.285 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:20.285 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:20.340 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T14:10:20.341 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T14:10:20.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:10:20.446 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:10:20.449 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T14:10:20.450 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T14:10:20.450 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T14:10:20.505 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T14:10:20.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T14:10:20.569 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T14:10:20.583 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T14:10:20.583 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:10:20.583 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T14:10:20.609 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:10:20.609 INFO:tasks.ceph:role: osd.0 2024-09-11T14:10:20.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-11T14:10:20.609 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:10:20.681 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:10:20.681 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:10:20.681 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:10:20.681 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:10:20.682 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:10:20.682 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:10:20.682 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:10:20.682 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:10:20.682 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:10:20.682 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:10:21.190 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-11T14:10:21.191 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-11T14:10:21.192 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T14:10:21.336 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T14:10:21.369 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T14:10:21.435 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:10:21.435 INFO:tasks.ceph:role: osd.1 2024-09-11T14:10:21.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-11T14:10:21.435 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:10:21.508 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:10:21.508 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:10:21.508 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:10:21.508 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:10:21.509 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:10:21.509 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:10:21.509 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:10:21.509 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:10:21.509 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:10:21.509 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:10:21.967 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-11T14:10:21.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-11T14:10:21.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T14:10:22.052 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T14:10:22.121 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:22.428 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:22.429 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:22,429 seastar - Reactor backend: linux-aio 2024-09-11T14:10:22.448 INFO:teuthology.orchestra.run.smithi097.stderr:==27877==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:22.687 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:22,686 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:10:22.687 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:22,686 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:10:22.688 INFO:teuthology.orchestra.run.smithi097.stderr:DEBUG 2024-09-11 14:10:22,688 [shard 0:main] seastar - reactor::drain 2024-09-11T14:10:23.235 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:23.235 INFO:teuthology.orchestra.run.smithi097.stderr:Suppressions used: 2024-09-11T14:10:23.235 INFO:teuthology.orchestra.run.smithi097.stderr: count bytes template 2024-09-11T14:10:23.236 INFO:teuthology.orchestra.run.smithi097.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:23.236 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:23.236 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:10:23.293 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:23.296 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:23,296 seastar - Reactor backend: linux-aio 2024-09-11T14:10:23.306 INFO:teuthology.orchestra.run.smithi097.stderr:==27874==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:27.968 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:27.968 INFO:teuthology.orchestra.run.smithi097.stderr:Suppressions used: 2024-09-11T14:10:27.968 INFO:teuthology.orchestra.run.smithi097.stderr: count bytes template 2024-09-11T14:10:27.968 INFO:teuthology.orchestra.run.smithi097.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:27.968 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:27.968 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:10:27.989 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T14:10:28.015 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:28.288 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:28.289 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:28,289 seastar - Reactor backend: linux-aio 2024-09-11T14:10:28.294 INFO:teuthology.orchestra.run.smithi097.stderr:==28064==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:28.399 INFO:teuthology.orchestra.run.smithi097.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133d18 0xdd332 0x4b14c 0x362b8f6 0x362ba9c 0x5f93f3b 0x5fb593c 0x5fb5bd6 0x5f9c7fc 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3961af8 0x39632d2 0x3803c28 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:10:28.399 INFO:teuthology.orchestra.run.smithi097.stderr:kernel callstack: 2024-09-11T14:10:28.413 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:28,413 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:10:28.413 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:28,413 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:10:28.414 INFO:teuthology.orchestra.run.smithi097.stderr:DEBUG 2024-09-11 14:10:28,414 [shard 0:main] seastar - reactor::drain 2024-09-11T14:10:28.919 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:28.919 INFO:teuthology.orchestra.run.smithi097.stderr:Suppressions used: 2024-09-11T14:10:28.919 INFO:teuthology.orchestra.run.smithi097.stderr: count bytes template 2024-09-11T14:10:28.919 INFO:teuthology.orchestra.run.smithi097.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:28.919 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:28.919 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:10:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:28.978 INFO:teuthology.orchestra.run.smithi097.stderr:INFO 2024-09-11 14:10:28,978 seastar - Reactor backend: linux-aio 2024-09-11T14:10:28.996 INFO:teuthology.orchestra.run.smithi097.stderr:==28062==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:33.958 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:33.958 INFO:teuthology.orchestra.run.smithi097.stderr:Suppressions used: 2024-09-11T14:10:33.958 INFO:teuthology.orchestra.run.smithi097.stderr: count bytes template 2024-09-11T14:10:33.959 INFO:teuthology.orchestra.run.smithi097.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:33.959 INFO:teuthology.orchestra.run.smithi097.stderr:----------------------------------------------------- 2024-09-11T14:10:33.959 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:10:33.980 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T14:10:34.005 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T14:10:34.037 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:10:34.037 INFO:tasks.ceph:role: osd.2 2024-09-11T14:10:34.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T14:10:34.037 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:10:34.114 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:10:34.115 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:10:34.115 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:10:34.626 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-11T14:10:34.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-11T14:10:34.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-11T14:10:34.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T14:10:34.783 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T14:10:34.851 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:10:34.851 INFO:tasks.ceph:role: osd.3 2024-09-11T14:10:34.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T14:10:34.851 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:10:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:10:34.925 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:10:34.925 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:10:34.925 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:10:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:10:34.925 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:10:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:10:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:10:34.926 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:10:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:10:35.395 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-11T14:10:35.397 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-11T14:10:35.398 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-11T14:10:35.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T14:10:35.524 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:35.825 INFO:teuthology.orchestra.run.smithi117.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:35.826 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:35,825 seastar - Reactor backend: linux-aio 2024-09-11T14:10:35.841 INFO:teuthology.orchestra.run.smithi117.stderr:==27524==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:35.946 INFO:teuthology.orchestra.run.smithi117.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10252a 0x10d76c 0xdd31a 0x4b14c 0x381a16c 0x5fc08ac 0x5fc0ab5 0x601bcd4 0x5f9beb6 0x5f9c090 0x5f9c61c 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3961af8 0x39632d2 0x3803c28 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:10:35.946 INFO:teuthology.orchestra.run.smithi117.stderr:kernel callstack: 2024-09-11T14:10:35.959 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:35,959 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:10:35.959 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:35,959 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:10:35.960 INFO:teuthology.orchestra.run.smithi117.stderr:DEBUG 2024-09-11 14:10:35,960 [shard 0:main] seastar - reactor::drain 2024-09-11T14:10:36.468 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:36.468 INFO:teuthology.orchestra.run.smithi117.stderr:Suppressions used: 2024-09-11T14:10:36.468 INFO:teuthology.orchestra.run.smithi117.stderr: count bytes template 2024-09-11T14:10:36.468 INFO:teuthology.orchestra.run.smithi117.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:36.468 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:36.468 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-11T14:10:36.522 INFO:teuthology.orchestra.run.smithi117.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:36.526 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:36,525 seastar - Reactor backend: linux-aio 2024-09-11T14:10:36.535 INFO:teuthology.orchestra.run.smithi117.stderr:==27522==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:36.600 INFO:teuthology.orchestra.run.smithi117.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133d18 0xdd332 0x4b7ec 0x5fc0357 0x5fc098f 0x5fc0ab5 0x601bcd4 0x5f9beb6 0x5f9c090 0x5f9c61c 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:10:36.600 INFO:teuthology.orchestra.run.smithi117.stderr:kernel callstack: 2024-09-11T14:10:41.237 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:41.238 INFO:teuthology.orchestra.run.smithi117.stderr:Suppressions used: 2024-09-11T14:10:41.238 INFO:teuthology.orchestra.run.smithi117.stderr: count bytes template 2024-09-11T14:10:41.238 INFO:teuthology.orchestra.run.smithi117.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:41.238 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:41.238 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-11T14:10:41.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T14:10:41.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:41.564 INFO:teuthology.orchestra.run.smithi117.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:41,565 seastar - Reactor backend: linux-aio 2024-09-11T14:10:41.570 INFO:teuthology.orchestra.run.smithi117.stderr:==27710==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:41.677 INFO:teuthology.orchestra.run.smithi117.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5f97be6 0x5f9c11a 0x5f9c61c 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3961af8 0x39632d2 0x3803c28 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:10:41.677 INFO:teuthology.orchestra.run.smithi117.stderr:kernel callstack: 2024-09-11T14:10:41.692 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:41,692 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:10:41.692 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:41,692 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:10:41.693 INFO:teuthology.orchestra.run.smithi117.stderr:DEBUG 2024-09-11 14:10:41,693 [shard 0:main] seastar - reactor::drain 2024-09-11T14:10:42.199 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:42.199 INFO:teuthology.orchestra.run.smithi117.stderr:Suppressions used: 2024-09-11T14:10:42.199 INFO:teuthology.orchestra.run.smithi117.stderr: count bytes template 2024-09-11T14:10:42.199 INFO:teuthology.orchestra.run.smithi117.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:42.200 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:42.200 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-11T14:10:42.258 INFO:teuthology.orchestra.run.smithi117.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:10:42.261 INFO:teuthology.orchestra.run.smithi117.stderr:INFO 2024-09-11 14:10:42,261 seastar - Reactor backend: linux-aio 2024-09-11T14:10:42.276 INFO:teuthology.orchestra.run.smithi117.stderr:==27708==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:10:46.975 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:46.975 INFO:teuthology.orchestra.run.smithi117.stderr:Suppressions used: 2024-09-11T14:10:46.975 INFO:teuthology.orchestra.run.smithi117.stderr: count bytes template 2024-09-11T14:10:46.975 INFO:teuthology.orchestra.run.smithi117.stderr: 1 8 MallocExtension::Register 2024-09-11T14:10:46.976 INFO:teuthology.orchestra.run.smithi117.stderr:----------------------------------------------------- 2024-09-11T14:10:46.976 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-11T14:10:46.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T14:10:47.022 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T14:10:47.023 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:47.023 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T14:10:47.053 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:47.053 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T14:10:47.122 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:47.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T14:10:47.148 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:47.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T14:10:47.212 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:47.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T14:10:47.277 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:47.277 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T14:10:47.295 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:47.296 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T14:10:47.333 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T14:10:47.334 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T14:10:47.362 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDPpOFmBvsFGxAAQ2iVaipiJprq2OCwDeibpQ== 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDVpOFmEHSBCBAAk/LPt//SNLNiN8/RxQbMTA== 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDMpOFmSJOcGhAAmQgb9+oVBJMk6a27TerJrw== 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDcpOFmfiOyKBAARLiAh+983q4gDLaa6SKW/g== 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDipOFm3YRnGRAAk/4RMSrrT9I0iMwcWLMpgA== 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-09-11T14:10:47.363 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDMpOFm1BIWHhAADH6r5TM//k0ZBIImJV9L9Q== 2024-09-11T14:10:47.364 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2024-09-11T14:10:47.364 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDMpOFmL1PuIRAAa1wNP4zItuZzk/s5/lBv5w== 2024-09-11T14:10:47.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:10:47.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:10:47.535 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T14:10:47.595 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:10:47.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:10:47.717 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:10:47.786 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:10:47.851 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T14:10:47.851 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T14:10:47.876 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T14:10:47.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:47.983+0000 7ff8c8928c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:47.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:47.984+0000 7ff8c8928c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:47.999 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T14:10:48.024 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:10:48.079 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T14:10:48.080 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T14:10:48.080 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T14:10:48.123 INFO:tasks.ceph.mon.a:Started 2024-09-11T14:10:48.123 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T14:10:48.123 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T14:10:48.123 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T14:10:48.126 INFO:tasks.ceph.mgr.x:Started 2024-09-11T14:10:48.126 DEBUG:tasks.ceph:set 0 configs 2024-09-11T14:10:48.126 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T14:10:48.126 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T14:10:48.203 INFO:tasks.ceph.mon.a.smithi097.stderr:2024-09-11T14:10:48.200+0000 7f25a0cd6c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.203 INFO:tasks.ceph.mon.a.smithi097.stderr:2024-09-11T14:10:48.200+0000 7f25a0cd6c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.203 INFO:tasks.ceph.mon.a.smithi097.stderr:2024-09-11T14:10:48.200+0000 7f25a0cd6c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.219 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-09-11T14:10:48.218+0000 7f1a9fdc4000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.225+0000 7fb8eaf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.233+0000 7fb8eaf91640 1 Processor -- start 2024-09-11T14:10:48.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.233+0000 7fb8eaf91640 1 -- start start 2024-09-11T14:10:48.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.234+0000 7fb8eaf91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb8e409d1b0 0x7fb8e4138520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:48.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.234+0000 7fb8eaf91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e406d600 con 0x7fb8e409c690 2024-09-11T14:10:48.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.234+0000 7fb8eaf91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e4075380 con 0x7fb8e409d1b0 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.234+0000 7fb8e8d2d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb8e409c690 0x7fb8e409caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53990/0 (socket says 172.21.15.97:53990) 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.234+0000 7fb8e8d2d640 1 -- 172.21.15.97:0/3658507643 learned_addr learned my addr 172.21.15.97:0/3658507643 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.234+0000 7fb8e3fff640 1 --2- 172.21.15.97:0/3658507643 >> v2:172.21.15.97:3300/0 conn(0x7fb8e409d1b0 0x7fb8e4138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e37fe640 1 -- 172.21.15.97:0/3658507643 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308721807 0 0) 0x7fb8e406d600 con 0x7fb8e409c690 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e37fe640 1 -- 172.21.15.97:0/3658507643 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8d4005790 con 0x7fb8e409c690 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e3fff640 1 -- 172.21.15.97:0/3658507643 >> v1:172.21.15.97:6789/0 conn(0x7fb8e409c690 legacy=0x7fb8e409caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e3fff640 1 -- 172.21.15.97:0/3658507643 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e409da50 con 0x7fb8e409d1b0 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e3fff640 1 --2- 172.21.15.97:0/3658507643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409d1b0 0x7fb8e4138520 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61beab8cd2e8289e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e37fe640 1 -- 172.21.15.97:0/3658507643 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d0009d80 con 0x7fb8e409d1b0 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e37fe640 1 -- 172.21.15.97:0/3658507643 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb8d000e230 con 0x7fb8e409d1b0 2024-09-11T14:10:48.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.235+0000 7fb8e37fe640 1 -- 172.21.15.97:0/3658507643 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d000e4d0 con 0x7fb8e409d1b0 2024-09-11T14:10:48.239 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-09-11T14:10:48.237+0000 7f1a9fdc4000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.239 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-09-11T14:10:48.237+0000 7f1a9fdc4000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 1 -- 172.21.15.97:0/3658507643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409d1b0 msgr2=0x7fb8e4138520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 1 --2- 172.21.15.97:0/3658507643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409d1b0 0x7fb8e4138520 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 1 -- 172.21.15.97:0/3658507643 shutdown_connections 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 1 --2- 172.21.15.97:0/3658507643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409d1b0 0x7fb8e4138520 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 1 -- 172.21.15.97:0/3658507643 >> 172.21.15.97:0/3658507643 conn(0x7fb8e40a3230 msgr2=0x7fb8e40a3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 1 -- 172.21.15.97:0/3658507643 shutdown_connections 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 1 -- 172.21.15.97:0/3658507643 wait complete. 2024-09-11T14:10:48.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.236+0000 7fb8eaf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.237+0000 7fb8eaf91640 1 Processor -- start 2024-09-11T14:10:48.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.237+0000 7fb8eaf91640 1 -- start start 2024-09-11T14:10:48.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8eaf91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409c690 0x7fb8e4133560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:48.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8eaf91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e4130f90 con 0x7fb8e409c690 2024-09-11T14:10:48.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e8d2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409c690 0x7fb8e4133560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:48.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e8d2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409c690 0x7fb8e4133560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37294/0 (socket says 172.21.15.97:37294) 2024-09-11T14:10:48.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e8d2d640 1 -- 172.21.15.97:0/889305030 learned_addr learned my addr 172.21.15.97:0/889305030 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e8d2d640 1 -- 172.21.15.97:0/889305030 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e4130740 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e8d2d640 1 --2- 172.21.15.97:0/889305030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409c690 0x7fb8e4133560 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e17fa640 1 -- 172.21.15.97:0/889305030 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d8005a60 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e17fa640 1 -- 172.21.15.97:0/889305030 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb8d8005bc0 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e4132c30 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.239+0000 7fb8e17fa640 1 -- 172.21.15.97:0/889305030 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d8005e60 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.240+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e4133250 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.240+0000 7fb8e17fa640 1 -- 172.21.15.97:0/889305030 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fb8d8007440 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.240+0000 7fb8e17fa640 1 -- 172.21.15.97:0/889305030 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7fb8d800f8e0 con 0x7fb8e409c690 2024-09-11T14:10:48.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.240+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e409f310 con 0x7fb8e409c690 2024-09-11T14:10:48.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.243+0000 7fb8e17fa640 1 -- 172.21.15.97:0/889305030 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fb8d800fb40 con 0x7fb8e409c690 2024-09-11T14:10:48.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.305+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb8e4050fc0 con 0x7fb8e409c690 2024-09-11T14:10:48.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.306+0000 7fb8e17fa640 1 -- 172.21.15.97:0/889305030 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7fb8d800fce0 con 0x7fb8e409c690 2024-09-11T14:10:48.308 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2024-09-11T14:10:48.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.307+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409c690 msgr2=0x7fb8e4133560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:48.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.307+0000 7fb8eaf91640 1 --2- 172.21.15.97:0/889305030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409c690 0x7fb8e4133560 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:48.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.307+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 shutdown_connections 2024-09-11T14:10:48.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.307+0000 7fb8eaf91640 1 --2- 172.21.15.97:0/889305030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8e409c690 0x7fb8e4133560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:48.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.307+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 >> 172.21.15.97:0/889305030 conn(0x7fb8e40a3230 msgr2=0x7fb8e4072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:48.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.307+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 shutdown_connections 2024-09-11T14:10:48.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.307+0000 7fb8eaf91640 1 -- 172.21.15.97:0/889305030 wait complete. 2024-09-11T14:10:48.320 INFO:tasks.ceph:check_enable_crimson: True 2024-09-11T14:10:48.320 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-11T14:10:48.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-11T14:10:48.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.417+0000 7fd5d26d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.423+0000 7fd5d26d1640 1 Processor -- start 2024-09-11T14:10:48.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.423+0000 7fd5d26d1640 1 -- start start 2024-09-11T14:10:48.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5d26d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5cc1360f0 0x7fd5cc136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:48.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5d26d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5cc0a5c40 con 0x7fd5cc09e170 2024-09-11T14:10:48.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5d26d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd5cc0a6010 con 0x7fd5cc1360f0 2024-09-11T14:10:48.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5cbfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5cc1360f0 0x7fd5cc136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:48.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5cb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd5cc09e170 0x7fd5cc09e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54004/0 (socket says 172.21.15.97:54004) 2024-09-11T14:10:48.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5cbfff640 1 --2- 172.21.15.97:0/3122450937 >> v2:172.21.15.97:3300/0 conn(0x7fd5cc1360f0 0x7fd5cc136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37310/0 (socket says 172.21.15.97:37310) 2024-09-11T14:10:48.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/3122450937 learned_addr learned my addr 172.21.15.97:0/3122450937 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:10:48.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5cbfff640 1 -- 172.21.15.97:0/3122450937 >> v1:172.21.15.97:6789/0 conn(0x7fd5cc09e170 legacy=0x7fd5cc09e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:48.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5cbfff640 1 -- 172.21.15.97:0/3122450937 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc09f510 con 0x7fd5cc1360f0 2024-09-11T14:10:48.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5caffd640 1 -- 172.21.15.97:0/3122450937 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198176654 0 0) 0x7fd5cc0a5c40 con 0x7fd5cc09e170 2024-09-11T14:10:48.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.424+0000 7fd5cbfff640 1 --2- 172.21.15.97:0/3122450937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc1360f0 0x7fd5cc136500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68db677f15639b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:48.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5caffd640 1 -- 172.21.15.97:0/3122450937 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5bc009d90 con 0x7fd5cc1360f0 2024-09-11T14:10:48.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5caffd640 1 -- 172.21.15.97:0/3122450937 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd5bc00e230 con 0x7fd5cc1360f0 2024-09-11T14:10:48.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5caffd640 1 -- 172.21.15.97:0/3122450937 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5bc00e4d0 con 0x7fd5cc1360f0 2024-09-11T14:10:48.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5d26d1640 1 -- 172.21.15.97:0/3122450937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc1360f0 msgr2=0x7fd5cc136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:48.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5d26d1640 1 --2- 172.21.15.97:0/3122450937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc1360f0 0x7fd5cc136500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:48.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5d26d1640 1 -- 172.21.15.97:0/3122450937 shutdown_connections 2024-09-11T14:10:48.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5d26d1640 1 --2- 172.21.15.97:0/3122450937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc1360f0 0x7fd5cc136500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:48.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5d26d1640 1 -- 172.21.15.97:0/3122450937 >> 172.21.15.97:0/3122450937 conn(0x7fd5cc06f850 msgr2=0x7fd5cc09ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:48.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5d26d1640 1 -- 172.21.15.97:0/3122450937 shutdown_connections 2024-09-11T14:10:48.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.425+0000 7fd5d26d1640 1 -- 172.21.15.97:0/3122450937 wait complete. 2024-09-11T14:10:48.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.426+0000 7fd5d26d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:48.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.427+0000 7fd5d26d1640 1 Processor -- start 2024-09-11T14:10:48.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.427+0000 7fd5d26d1640 1 -- start start 2024-09-11T14:10:48.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.428+0000 7fd5d26d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc09e170 0x7fd5cc120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:48.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.428+0000 7fd5d26d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc124ba0 con 0x7fd5cc09e170 2024-09-11T14:10:48.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.428+0000 7fd5cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc09e170 0x7fd5cc120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:48.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.428+0000 7fd5cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc09e170 0x7fd5cc120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37312/0 (socket says 172.21.15.97:37312) 2024-09-11T14:10:48.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.428+0000 7fd5cbfff640 1 -- 172.21.15.97:0/1576285598 learned_addr learned my addr 172.21.15.97:0/1576285598 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:48.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.428+0000 7fd5cbfff640 1 -- 172.21.15.97:0/1576285598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc124810 con 0x7fd5cc09e170 2024-09-11T14:10:48.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5cbfff640 1 --2- 172.21.15.97:0/1576285598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc09e170 0x7fd5cc120b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:48.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5c8ff9640 1 -- 172.21.15.97:0/1576285598 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5bc013530 con 0x7fd5cc09e170 2024-09-11T14:10:48.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5c8ff9640 1 -- 172.21.15.97:0/1576285598 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd5bc013690 con 0x7fd5cc09e170 2024-09-11T14:10:48.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc121ff0 con 0x7fd5cc09e170 2024-09-11T14:10:48.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5c8ff9640 1 -- 172.21.15.97:0/1576285598 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5bc013930 con 0x7fd5cc09e170 2024-09-11T14:10:48.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc124500 con 0x7fd5cc09e170 2024-09-11T14:10:48.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5c8ff9640 1 -- 172.21.15.97:0/1576285598 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fd5bc0123f0 con 0x7fd5cc09e170 2024-09-11T14:10:48.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.429+0000 7fd5c8ff9640 1 -- 172.21.15.97:0/1576285598 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7fd5bc018040 con 0x7fd5cc09e170 2024-09-11T14:10:48.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.430+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc0008d0 con 0x7fd5cc09e170 2024-09-11T14:10:48.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.432+0000 7fd5c8ff9640 1 -- 172.21.15.97:0/1576285598 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fd5cc121ff0 con 0x7fd5cc09e170 2024-09-11T14:10:48.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:48.503+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7fd5cc1233d0 con 0x7fd5cc09e170 2024-09-11T14:10:48.506 INFO:tasks.ceph.mon.a.smithi097.stderr:2024-09-11T14:10:48.503+0000 7f25979f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-11T14:10:48.506 INFO:tasks.ceph.mon.a.smithi097.stderr:Please be aware that this feature is experimental, untested, 2024-09-11T14:10:48.506 INFO:tasks.ceph.mon.a.smithi097.stderr:unsupported, and may result in data corruption, data loss, 2024-09-11T14:10:48.506 INFO:tasks.ceph.mon.a.smithi097.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-11T14:10:48.506 INFO:tasks.ceph.mon.a.smithi097.stderr:feature with important data. 2024-09-11T14:10:48.506 INFO:tasks.ceph.mon.a.smithi097.stderr: 2024-09-11T14:10:49.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.307+0000 7fd5c8ff9640 1 -- 172.21.15.97:0/1576285598 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7fd5bc012880 con 0x7fd5cc09e170 2024-09-11T14:10:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.308+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc09e170 msgr2=0x7fd5cc120b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.308+0000 7fd5d26d1640 1 --2- 172.21.15.97:0/1576285598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc09e170 0x7fd5cc120b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.308+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 shutdown_connections 2024-09-11T14:10:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.308+0000 7fd5d26d1640 1 --2- 172.21.15.97:0/1576285598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5cc09e170 0x7fd5cc120b70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.308+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 >> 172.21.15.97:0/1576285598 conn(0x7fd5cc06f850 msgr2=0x7fd5cc1bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.308+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 shutdown_connections 2024-09-11T14:10:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:49.308+0000 7fd5d26d1640 1 -- 172.21.15.97:0/1576285598 wait complete. 2024-09-11T14:10:49.323 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T14:10:49.324 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:49.324 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T14:10:49.351 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:10:49.351 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T14:10:49.419 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:49.419 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T14:10:49.444 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T14:10:49.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T14:10:49.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 22e03614-3c25-4e5f-9dcc-6ea59cce138b 0 2024-09-11T14:10:49.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.650+0000 7ff59b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:49.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.656+0000 7ff59b191640 1 Processor -- start 2024-09-11T14:10:49.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.656+0000 7ff59b191640 1 -- start start 2024-09-11T14:10:49.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff59b191640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff59411acb0 0x7ff59411b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:49.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff59b191640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5941158e0 con 0x7ff594114dc0 2024-09-11T14:10:49.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff59b191640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff594115a70 con 0x7ff59411acb0 2024-09-11T14:10:49.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff598f2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff59411acb0 0x7ff59411b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:49.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff598f2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff59411acb0 0x7ff59411b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:34998/0 (socket says 172.21.15.117:34998) 2024-09-11T14:10:49.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff598f2d640 1 -- 172.21.15.117:0/1822034519 learned_addr learned my addr 172.21.15.117:0/1822034519 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:49.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff593fff640 1 --1- 172.21.15.117:0/1822034519 >> v1:172.21.15.97:6789/0 conn(0x7ff594114dc0 0x7ff5941151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.117:33370/0 (socket says 172.21.15.117:33370) 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff598f2d640 1 -- 172.21.15.117:0/1822034519 >> v1:172.21.15.97:6789/0 conn(0x7ff594114dc0 legacy=0x7ff5941151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.657+0000 7ff598f2d640 1 -- 172.21.15.117:0/1822034519 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff594115be0 con 0x7ff59411acb0 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.658+0000 7ff598f2d640 1 --2- 172.21.15.117:0/1822034519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff59411acb0 0x7ff59411b0c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa1907751a45eec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.658+0000 7ff5937fe640 1 -- 172.21.15.117:0/1822034519 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff584009e50 con 0x7ff59411acb0 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.658+0000 7ff5937fe640 1 -- 172.21.15.117:0/1822034519 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff58400e230 con 0x7ff59411acb0 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.658+0000 7ff5937fe640 1 -- 172.21.15.117:0/1822034519 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff58400e4d0 con 0x7ff59411acb0 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.658+0000 7ff59b191640 1 -- 172.21.15.117:0/1822034519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff59411acb0 msgr2=0x7ff59411b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.658+0000 7ff59b191640 1 --2- 172.21.15.117:0/1822034519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff59411acb0 0x7ff59411b0c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 1 -- 172.21.15.117:0/1822034519 shutdown_connections 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 1 --2- 172.21.15.117:0/1822034519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff59411acb0 0x7ff59411b0c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 1 -- 172.21.15.117:0/1822034519 >> 172.21.15.117:0/1822034519 conn(0x7ff59406e9b0 msgr2=0x7ff59406edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 1 -- 172.21.15.117:0/1822034519 shutdown_connections 2024-09-11T14:10:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 1 -- 172.21.15.117:0/1822034519 wait complete. 2024-09-11T14:10:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 1 Processor -- start 2024-09-11T14:10:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.659+0000 7ff59b191640 1 -- start start 2024-09-11T14:10:49.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.660+0000 7ff59b191640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff594114dc0 0x7ff5941a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:49.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.660+0000 7ff59b191640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff5941aa090 con 0x7ff594114dc0 2024-09-11T14:10:49.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.660+0000 7ff598f2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff594114dc0 0x7ff5941a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.660+0000 7ff598f2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff594114dc0 0x7ff5941a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:35014/0 (socket says 172.21.15.117:35014) 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.660+0000 7ff598f2d640 1 -- 172.21.15.117:0/527927625 learned_addr learned my addr 172.21.15.117:0/527927625 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff598f2d640 1 -- 172.21.15.117:0/527927625 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5941aa1d0 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff598f2d640 1 --2- 172.21.15.117:0/527927625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff594114dc0 0x7ff5941a9ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff5917fa640 1 -- 172.21.15.117:0/527927625 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff58400eea0 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff5917fa640 1 -- 172.21.15.117:0/527927625 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff584015420 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff5917fa640 1 -- 172.21.15.117:0/527927625 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff5840156c0 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5941aa420 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5941af3a0 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff5917fa640 1 -- 172.21.15.117:0/527927625 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff584015c00 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.661+0000 7ff5917fa640 1 -- 172.21.15.117:0/527927625 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7ff5840116d0 con 0x7ff594114dc0 2024-09-11T14:10:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.662+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff594120cf0 con 0x7ff594114dc0 2024-09-11T14:10:49.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.665+0000 7ff5917fa640 1 -- 172.21.15.117:0/527927625 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7ff584011930 con 0x7ff594114dc0 2024-09-11T14:10:49.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.736+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22e03614-3c25-4e5f-9dcc-6ea59cce138b", "id": 0} v 0) -- 0x7ff594120ed0 con 0x7ff594114dc0 2024-09-11T14:10:49.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.738+0000 7ff5917fa640 1 -- 172.21.15.117:0/527927625 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22e03614-3c25-4e5f-9dcc-6ea59cce138b", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7ff584011ad0 con 0x7ff594114dc0 2024-09-11T14:10:49.739 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-09-11T14:10:49.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.739+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff594114dc0 msgr2=0x7ff5941a9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:49.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.739+0000 7ff59b191640 1 --2- 172.21.15.117:0/527927625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff594114dc0 0x7ff5941a9ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.739+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 shutdown_connections 2024-09-11T14:10:49.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.739+0000 7ff59b191640 1 --2- 172.21.15.117:0/527927625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff594114dc0 0x7ff5941a9ac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.739+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 >> 172.21.15.117:0/527927625 conn(0x7ff59406e9b0 msgr2=0x7ff594113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:49.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.739+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 shutdown_connections 2024-09-11T14:10:49.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.739+0000 7ff59b191640 1 -- 172.21.15.117:0/527927625 wait complete. 2024-09-11T14:10:49.751 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new d2ff11a2-ef9b-4bd8-aaa9-73003208b30a 1 2024-09-11T14:10:49.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.851+0000 7fe0f4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:49.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.857+0000 7fe0f4f91640 1 Processor -- start 2024-09-11T14:10:49.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.857+0000 7fe0f4f91640 1 -- start start 2024-09-11T14:10:49.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.858+0000 7fe0f4f91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0f011acb0 0x7fe0f011b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.858+0000 7fe0f4f91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f01158e0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.858+0000 7fe0f4f91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f0115a70 con 0x7fe0f011acb0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.858+0000 7fe0ee59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0f011acb0 0x7fe0f011b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.858+0000 7fe0ee59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0f011acb0 0x7fe0f011b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:35024/0 (socket says 172.21.15.117:35024) 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.858+0000 7fe0ee59c640 1 -- 172.21.15.117:0/350237243 learned_addr learned my addr 172.21.15.117:0/350237243 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.859+0000 7fe0ee59c640 1 -- 172.21.15.117:0/350237243 >> v1:172.21.15.97:6789/0 conn(0x7fe0f0114dc0 legacy=0x7fe0f01151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.859+0000 7fe0ed59a640 1 -- 172.21.15.117:0/350237243 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586980613 0 0) 0x7fe0f01158e0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.859+0000 7fe0ee59c640 1 -- 172.21.15.117:0/350237243 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f0115be0 con 0x7fe0f011acb0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.859+0000 7fe0ee59c640 1 --2- 172.21.15.117:0/350237243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f011acb0 0x7fe0f011b0c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572359aa471b8ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.859+0000 7fe0ed59a640 1 -- 172.21.15.117:0/350237243 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0e800e040 con 0x7fe0f011acb0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.859+0000 7fe0ed59a640 1 -- 172.21.15.117:0/350237243 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe0e80091e0 con 0x7fe0f011acb0 2024-09-11T14:10:49.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.859+0000 7fe0ed59a640 1 -- 172.21.15.117:0/350237243 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0e8007730 con 0x7fe0f011acb0 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 1 -- 172.21.15.117:0/350237243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f011acb0 msgr2=0x7fe0f011b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 1 --2- 172.21.15.117:0/350237243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f011acb0 0x7fe0f011b0c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 1 -- 172.21.15.117:0/350237243 shutdown_connections 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 1 --2- 172.21.15.117:0/350237243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f011acb0 0x7fe0f011b0c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 1 -- 172.21.15.117:0/350237243 >> 172.21.15.117:0/350237243 conn(0x7fe0f006e9b0 msgr2=0x7fe0f006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 1 -- 172.21.15.117:0/350237243 shutdown_connections 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 1 -- 172.21.15.117:0/350237243 wait complete. 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.860+0000 7fe0f4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.861+0000 7fe0f4f91640 1 Processor -- start 2024-09-11T14:10:49.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.861+0000 7fe0f4f91640 1 -- start start 2024-09-11T14:10:49.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.861+0000 7fe0f4f91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f0114dc0 0x7fe0f01a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:49.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.861+0000 7fe0f4f91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01a9ee0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.862+0000 7fe0ee59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f0114dc0 0x7fe0f01a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:49.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.862+0000 7fe0ee59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f0114dc0 0x7fe0f01a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:35030/0 (socket says 172.21.15.117:35030) 2024-09-11T14:10:49.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.862+0000 7fe0ee59c640 1 -- 172.21.15.117:0/1090138539 learned_addr learned my addr 172.21.15.117:0/1090138539 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:49.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.862+0000 7fe0ee59c640 1 -- 172.21.15.117:0/1090138539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f01aa020 con 0x7fe0f0114dc0 2024-09-11T14:10:49.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.862+0000 7fe0ee59c640 1 --2- 172.21.15.117:0/1090138539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f0114dc0 0x7fe0f01a9910 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:49.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0e6ffd640 1 -- 172.21.15.117:0/1090138539 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0e800e040 con 0x7fe0f0114dc0 2024-09-11T14:10:49.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0e6ffd640 1 -- 172.21.15.117:0/1090138539 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe0e8010960 con 0x7fe0f0114dc0 2024-09-11T14:10:49.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f01aa270 con 0x7fe0f0114dc0 2024-09-11T14:10:49.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0e6ffd640 1 -- 172.21.15.117:0/1090138539 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0e8010c00 con 0x7fe0f0114dc0 2024-09-11T14:10:49.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f01af1f0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0e6ffd640 1 -- 172.21.15.117:0/1090138539 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fe0e80157e0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0e6ffd640 1 -- 172.21.15.117:0/1090138539 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7fe0e8014b10 con 0x7fe0f0114dc0 2024-09-11T14:10:49.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.863+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f0120cf0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.866+0000 7fe0e6ffd640 1 -- 172.21.15.117:0/1090138539 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fe0e80095b0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.935+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2ff11a2-ef9b-4bd8-aaa9-73003208b30a", "id": 1} v 0) -- 0x7fe0f0120ed0 con 0x7fe0f0114dc0 2024-09-11T14:10:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.937+0000 7fe0e6ffd640 1 -- 172.21.15.117:0/1090138539 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2ff11a2-ef9b-4bd8-aaa9-73003208b30a", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7fe0e8010e00 con 0x7fe0f0114dc0 2024-09-11T14:10:49.938 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-11T14:10:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.938+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f0114dc0 msgr2=0x7fe0f01a9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.938+0000 7fe0f4f91640 1 --2- 172.21.15.117:0/1090138539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f0114dc0 0x7fe0f01a9910 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.938+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 shutdown_connections 2024-09-11T14:10:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.938+0000 7fe0f4f91640 1 --2- 172.21.15.117:0/1090138539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0f0114dc0 0x7fe0f01a9910 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.938+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 >> 172.21.15.117:0/1090138539 conn(0x7fe0f006e9b0 msgr2=0x7fe0f0113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.938+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 shutdown_connections 2024-09-11T14:10:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:49.938+0000 7fe0f4f91640 1 -- 172.21.15.117:0/1090138539 wait complete. 2024-09-11T14:10:49.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 40d2d04e-30e4-45e0-bbb5-a159d1eb2779 2 2024-09-11T14:10:50.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.049+0000 7fcccc351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:50.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.056+0000 7fcccc351640 1 Processor -- start 2024-09-11T14:10:50.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.056+0000 7fcccc351640 1 -- start start 2024-09-11T14:10:50.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.056+0000 7fcccc351640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fccc411acb0 0x7fccc411b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:50.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.056+0000 7fcccc351640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc41158e0 con 0x7fccc4114dc0 2024-09-11T14:10:50.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.056+0000 7fcccc351640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fccc4115a70 con 0x7fccc411acb0 2024-09-11T14:10:50.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.057+0000 7fccca0ed640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fccc411acb0 0x7fccc411b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:50.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.057+0000 7fccca0ed640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fccc411acb0 0x7fccc411b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:35038/0 (socket says 172.21.15.117:35038) 2024-09-11T14:10:50.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.057+0000 7fccca0ed640 1 -- 172.21.15.117:0/2405491020 learned_addr learned my addr 172.21.15.117:0/2405491020 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:50.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.057+0000 7fccca0ed640 1 -- 172.21.15.117:0/2405491020 >> v1:172.21.15.97:6789/0 conn(0x7fccc4114dc0 legacy=0x7fccc41151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.057+0000 7fccca0ed640 1 -- 172.21.15.117:0/2405491020 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc4115be0 con 0x7fccc411acb0 2024-09-11T14:10:50.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.057+0000 7fccca0ed640 1 --2- 172.21.15.117:0/2405491020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc411acb0 0x7fccc411b0c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7593bb621599112d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:50.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.058+0000 7fccc90eb640 1 -- 172.21.15.117:0/2405491020 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fccc0009e50 con 0x7fccc411acb0 2024-09-11T14:10:50.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.058+0000 7fccc90eb640 1 -- 172.21.15.117:0/2405491020 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fccc000e230 con 0x7fccc411acb0 2024-09-11T14:10:50.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.058+0000 7fccc90eb640 1 -- 172.21.15.117:0/2405491020 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fccc000e4d0 con 0x7fccc411acb0 2024-09-11T14:10:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.058+0000 7fcccc351640 1 -- 172.21.15.117:0/2405491020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc411acb0 msgr2=0x7fccc411b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.058+0000 7fcccc351640 1 --2- 172.21.15.117:0/2405491020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc411acb0 0x7fccc411b0c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 1 -- 172.21.15.117:0/2405491020 shutdown_connections 2024-09-11T14:10:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 1 --2- 172.21.15.117:0/2405491020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc411acb0 0x7fccc411b0c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 1 -- 172.21.15.117:0/2405491020 >> 172.21.15.117:0/2405491020 conn(0x7fccc406e9b0 msgr2=0x7fccc406edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 1 -- 172.21.15.117:0/2405491020 shutdown_connections 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 1 -- 172.21.15.117:0/2405491020 wait complete. 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 1 Processor -- start 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.059+0000 7fcccc351640 1 -- start start 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.060+0000 7fcccc351640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc4114dc0 0x7fccc41a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.060+0000 7fcccc351640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fccc41aa090 con 0x7fccc4114dc0 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.060+0000 7fccca0ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc4114dc0 0x7fccc41a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.060+0000 7fccca0ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc4114dc0 0x7fccc41a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:35050/0 (socket says 172.21.15.117:35050) 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.060+0000 7fccca0ed640 1 -- 172.21.15.117:0/4064543540 learned_addr learned my addr 172.21.15.117:0/4064543540 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.060+0000 7fccca0ed640 1 -- 172.21.15.117:0/4064543540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc41aa1d0 con 0x7fccc4114dc0 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.060+0000 7fccca0ed640 1 --2- 172.21.15.117:0/4064543540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc4114dc0 0x7fccc41a9ac0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.061+0000 7fccb6ffd640 1 -- 172.21.15.117:0/4064543540 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fccc000eea0 con 0x7fccc4114dc0 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.061+0000 7fccb6ffd640 1 -- 172.21.15.117:0/4064543540 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fccc0015420 con 0x7fccc4114dc0 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.061+0000 7fccb6ffd640 1 -- 172.21.15.117:0/4064543540 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fccc00156c0 con 0x7fccc4114dc0 2024-09-11T14:10:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.061+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc41aa420 con 0x7fccc4114dc0 2024-09-11T14:10:50.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.061+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc41af3a0 con 0x7fccc4114dc0 2024-09-11T14:10:50.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.061+0000 7fccb6ffd640 1 -- 172.21.15.117:0/4064543540 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fccc0015c50 con 0x7fccc4114dc0 2024-09-11T14:10:50.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.061+0000 7fccb6ffd640 1 -- 172.21.15.117:0/4064543540 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7fccc00117c0 con 0x7fccc4114dc0 2024-09-11T14:10:50.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.062+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc4120cf0 con 0x7fccc4114dc0 2024-09-11T14:10:50.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.064+0000 7fccb6ffd640 1 -- 172.21.15.117:0/4064543540 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fccc0011380 con 0x7fccc4114dc0 2024-09-11T14:10:50.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.134+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "40d2d04e-30e4-45e0-bbb5-a159d1eb2779", "id": 2} v 0) -- 0x7fccc4120e80 con 0x7fccc4114dc0 2024-09-11T14:10:50.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.138+0000 7fccb6ffd640 1 -- 172.21.15.117:0/4064543540 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40d2d04e-30e4-45e0-bbb5-a159d1eb2779", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7fccc00115a0 con 0x7fccc4114dc0 2024-09-11T14:10:50.140 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-09-11T14:10:50.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.139+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc4114dc0 msgr2=0x7fccc41a9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.139+0000 7fcccc351640 1 --2- 172.21.15.117:0/4064543540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc4114dc0 0x7fccc41a9ac0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.139+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 shutdown_connections 2024-09-11T14:10:50.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.139+0000 7fcccc351640 1 --2- 172.21.15.117:0/4064543540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc4114dc0 0x7fccc41a9ac0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.139+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 >> 172.21.15.117:0/4064543540 conn(0x7fccc406e9b0 msgr2=0x7fccc4113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:50.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.139+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 shutdown_connections 2024-09-11T14:10:50.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.139+0000 7fcccc351640 1 -- 172.21.15.117:0/4064543540 wait complete. 2024-09-11T14:10:50.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new b73e62e2-3d2b-4bf6-8961-2ea27b214707 3 2024-09-11T14:10:50.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.251+0000 7f94c80d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:50.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.257+0000 7f94c80d1640 1 Processor -- start 2024-09-11T14:10:50.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.257+0000 7f94c80d1640 1 -- start start 2024-09-11T14:10:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c80d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94c011d970 0x7f94c011fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c80d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c01204a0 con 0x7f94c011acb0 2024-09-11T14:10:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c80d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f94c0121660 con 0x7f94c011d970 2024-09-11T14:10:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c566c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94c011d970 0x7f94c011fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c566c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94c011d970 0x7f94c011fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:35052/0 (socket says 172.21.15.117:35052) 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c566c640 1 -- 172.21.15.117:0/1661319532 learned_addr learned my addr 172.21.15.117:0/1661319532 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c5e6d640 1 --1- 172.21.15.117:0/1661319532 >> v1:172.21.15.97:6789/0 conn(0x7f94c011acb0 0x7f94c011b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.117:33396/0 (socket says 172.21.15.117:33396) 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c4e6b640 1 -- 172.21.15.117:0/1661319532 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095200124 0 0) 0x7f94c01204a0 con 0x7f94c011acb0 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.258+0000 7f94c4e6b640 1 -- 172.21.15.117:0/1661319532 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94ac003580 con 0x7f94c011acb0 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.259+0000 7f94c566c640 1 -- 172.21.15.117:0/1661319532 >> v1:172.21.15.97:6789/0 conn(0x7f94c011acb0 legacy=0x7f94c011b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.259+0000 7f94c566c640 1 -- 172.21.15.117:0/1661319532 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c01217d0 con 0x7f94c011d970 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.259+0000 7f94c566c640 1 --2- 172.21.15.117:0/1661319532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011d970 0x7f94c011fdf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5309d52408ea642e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.259+0000 7f94c4e6b640 1 -- 172.21.15.117:0/1661319532 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f94bc009e50 con 0x7f94c011d970 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.259+0000 7f94c4e6b640 1 -- 172.21.15.117:0/1661319532 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f94bc00e230 con 0x7f94c011d970 2024-09-11T14:10:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.259+0000 7f94c4e6b640 1 -- 172.21.15.117:0/1661319532 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f94bc00e4d0 con 0x7f94c011d970 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 1 -- 172.21.15.117:0/1661319532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011d970 msgr2=0x7f94c011fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 1 --2- 172.21.15.117:0/1661319532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011d970 0x7f94c011fdf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 1 -- 172.21.15.117:0/1661319532 shutdown_connections 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 1 --2- 172.21.15.117:0/1661319532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011d970 0x7f94c011fdf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 1 -- 172.21.15.117:0/1661319532 >> 172.21.15.117:0/1661319532 conn(0x7f94c006e9b0 msgr2=0x7f94c006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 1 -- 172.21.15.117:0/1661319532 shutdown_connections 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 1 -- 172.21.15.117:0/1661319532 wait complete. 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.260+0000 7f94c80d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.261+0000 7f94c80d1640 1 Processor -- start 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.261+0000 7f94c80d1640 1 -- start start 2024-09-11T14:10:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.261+0000 7f94c80d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011acb0 0x7f94c01a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:50.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.261+0000 7f94c80d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f94c01a9fc0 con 0x7f94c011acb0 2024-09-11T14:10:50.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.261+0000 7f94c5e6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011acb0 0x7f94c01a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:50.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.261+0000 7f94c5e6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011acb0 0x7f94c01a99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.117:35064/0 (socket says 172.21.15.117:35064) 2024-09-11T14:10:50.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94c5e6d640 1 -- 172.21.15.117:0/3628621572 learned_addr learned my addr 172.21.15.117:0/3628621572 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T14:10:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94c5e6d640 1 -- 172.21.15.117:0/3628621572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c01aa100 con 0x7f94c011acb0 2024-09-11T14:10:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94c5e6d640 1 --2- 172.21.15.117:0/3628621572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011acb0 0x7f94c01a99f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94b67fc640 1 -- 172.21.15.117:0/3628621572 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f94b00059a0 con 0x7f94c011acb0 2024-09-11T14:10:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94b67fc640 1 -- 172.21.15.117:0/3628621572 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f94b0005b00 con 0x7f94c011acb0 2024-09-11T14:10:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c01aa3b0 con 0x7f94c011acb0 2024-09-11T14:10:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94b67fc640 1 -- 172.21.15.117:0/3628621572 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f94b0005da0 con 0x7f94c011acb0 2024-09-11T14:10:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c01af250 con 0x7f94c011acb0 2024-09-11T14:10:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94b67fc640 1 -- 172.21.15.117:0/3628621572 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f94b0007440 con 0x7f94c011acb0 2024-09-11T14:10:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.262+0000 7f94b67fc640 1 -- 172.21.15.117:0/3628621572 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7f94b000f230 con 0x7f94c011acb0 2024-09-11T14:10:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.263+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c01210f0 con 0x7f94c011acb0 2024-09-11T14:10:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.266+0000 7f94b67fc640 1 -- 172.21.15.117:0/3628621572 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f94b000c7f0 con 0x7f94c011acb0 2024-09-11T14:10:50.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.337+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b73e62e2-3d2b-4bf6-8961-2ea27b214707", "id": 3} v 0) -- 0x7f94c0120990 con 0x7f94c011acb0 2024-09-11T14:10:50.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.341+0000 7f94b67fc640 1 -- 172.21.15.117:0/3628621572 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b73e62e2-3d2b-4bf6-8961-2ea27b214707", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7f94b000ca10 con 0x7f94c011acb0 2024-09-11T14:10:50.342 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-09-11T14:10:50.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.342+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011acb0 msgr2=0x7f94c01a99f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.342+0000 7f94c80d1640 1 --2- 172.21.15.117:0/3628621572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011acb0 0x7f94c01a99f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.342+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 shutdown_connections 2024-09-11T14:10:50.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.342+0000 7f94c80d1640 1 --2- 172.21.15.117:0/3628621572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94c011acb0 0x7f94c01a99f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.342+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 >> 172.21.15.117:0/3628621572 conn(0x7f94c006e9b0 msgr2=0x7f94c011dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:50.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.342+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 shutdown_connections 2024-09-11T14:10:50.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T14:10:50.342+0000 7f94c80d1640 1 -- 172.21.15.117:0/3628621572 wait complete. 2024-09-11T14:10:50.354 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-11T14:10:50.389 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T14:10:50.390 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-11T14:10:50.432 INFO:tasks.ceph.osd.0:Started 2024-09-11T14:10:50.433 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-11T14:10:50.465 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T14:10:50.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-11T14:10:50.507 INFO:tasks.ceph.osd.1:Started 2024-09-11T14:10:50.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-11T14:10:50.537 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T14:10:50.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-11T14:10:50.581 INFO:tasks.ceph.osd.2:Started 2024-09-11T14:10:50.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-11T14:10:50.610 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T14:10:50.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-11T14:10:50.653 INFO:tasks.ceph.osd.3:Started 2024-09-11T14:10:50.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:10:50.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.761+0000 7f9e40f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:50.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.766+0000 7f9e40f91640 1 Processor -- start 2024-09-11T14:10:50.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.766+0000 7f9e40f91640 1 -- start start 2024-09-11T14:10:50.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e40f91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e3c1360f0 0x7f9e3c136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:50.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e40f91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e3c0a5c40 con 0x7f9e3c09e170 2024-09-11T14:10:50.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e40f91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9e3c0a6010 con 0x7f9e3c1360f0 2024-09-11T14:10:50.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e3a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e3c1360f0 0x7f9e3c136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:50.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e31d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9e3c09e170 0x7f9e3c09e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54020/0 (socket says 172.21.15.97:54020) 2024-09-11T14:10:50.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e31d9b640 1 -- 172.21.15.97:0/4239506137 learned_addr learned my addr 172.21.15.97:0/4239506137 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:10:50.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e3a59c640 1 -- 172.21.15.97:0/4239506137 >> v1:172.21.15.97:6789/0 conn(0x7f9e3c09e170 legacy=0x7f9e3c09e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e3a59c640 1 -- 172.21.15.97:0/4239506137 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3c09f510 con 0x7f9e3c1360f0 2024-09-11T14:10:50.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e39d9b640 1 -- 172.21.15.97:0/4239506137 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057371241 0 0) 0x7f9e3c0a5c40 con 0x7f9e3c09e170 2024-09-11T14:10:50.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e3a59c640 1 --2- 172.21.15.97:0/4239506137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c1360f0 0x7f9e3c136500 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585a9a286714aa6f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:50.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e39d9b640 1 -- 172.21.15.97:0/4239506137 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e2c009d90 con 0x7f9e3c1360f0 2024-09-11T14:10:50.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e39d9b640 1 -- 172.21.15.97:0/4239506137 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9e2c00e230 con 0x7f9e3c1360f0 2024-09-11T14:10:50.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.768+0000 7f9e39d9b640 1 -- 172.21.15.97:0/4239506137 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e2c00e4d0 con 0x7f9e3c1360f0 2024-09-11T14:10:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.769+0000 7f9e40f91640 1 -- 172.21.15.97:0/4239506137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c1360f0 msgr2=0x7f9e3c136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.769+0000 7f9e40f91640 1 --2- 172.21.15.97:0/4239506137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c1360f0 0x7f9e3c136500 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.769+0000 7f9e40f91640 1 -- 172.21.15.97:0/4239506137 shutdown_connections 2024-09-11T14:10:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.769+0000 7f9e40f91640 1 --2- 172.21.15.97:0/4239506137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c1360f0 0x7f9e3c136500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.769+0000 7f9e40f91640 1 -- 172.21.15.97:0/4239506137 >> 172.21.15.97:0/4239506137 conn(0x7f9e3c06f850 msgr2=0x7f9e3c09ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.769+0000 7f9e40f91640 1 -- 172.21.15.97:0/4239506137 shutdown_connections 2024-09-11T14:10:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.769+0000 7f9e40f91640 1 -- 172.21.15.97:0/4239506137 wait complete. 2024-09-11T14:10:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.770+0000 7f9e40f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.771+0000 7f9e40f91640 1 Processor -- start 2024-09-11T14:10:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.771+0000 7f9e40f91640 1 -- start start 2024-09-11T14:10:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.772+0000 7f9e40f91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c09e170 0x7f9e3c123b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.772+0000 7f9e40f91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c135060 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.772+0000 7f9e3a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c09e170 0x7f9e3c123b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.772+0000 7f9e3a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c09e170 0x7f9e3c123b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37338/0 (socket says 172.21.15.97:37338) 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.772+0000 7f9e3a59c640 1 -- 172.21.15.97:0/561837232 learned_addr learned my addr 172.21.15.97:0/561837232 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e3a59c640 1 -- 172.21.15.97:0/561837232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3c122440 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e3a59c640 1 --2- 172.21.15.97:0/561837232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c09e170 0x7f9e3c123b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e337fe640 1 -- 172.21.15.97:0/561837232 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e2c014620 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e337fe640 1 -- 172.21.15.97:0/561837232 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9e2c014780 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3c121df0 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e337fe640 1 -- 172.21.15.97:0/561837232 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e2c014a20 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3c121ae0 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e337fe640 1 -- 172.21.15.97:0/561837232 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f9e2c013400 con 0x7f9e3c09e170 2024-09-11T14:10:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.773+0000 7f9e337fe640 1 -- 172.21.15.97:0/561837232 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e3c09e170 2024-09-11T14:10:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.774+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3c1241d0 con 0x7f9e3c09e170 2024-09-11T14:10:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.777+0000 7f9e337fe640 1 -- 172.21.15.97:0/561837232 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f9e2c011bc0 con 0x7f9e3c09e170 2024-09-11T14:10:50.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.837+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e3c124890 con 0x7f9e3c09e170 2024-09-11T14:10:50.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.837+0000 7f9e337fe640 1 -- 172.21.15.97:0/561837232 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f9e2c011e10 con 0x7f9e3c09e170 2024-09-11T14:10:50.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:10:50.840 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":7,"fsid":"f3855fa8-d59d-46b3-8802-359d51f9681f","created":"2024-09-11T14:10:48.224532+0000","modified":"2024-09-11T14:10:50.338674+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:10:50.338674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"22e03614-3c25-4e5f-9dcc-6ea59cce138b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2ff11a2-ef9b-4bd8-aaa9-73003208b30a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"40d2d04e-30e4-45e0-bbb5-a159d1eb2779","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b73e62e2-3d2b-4bf6-8961-2ea27b214707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:10:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.838+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c09e170 msgr2=0x7f9e3c123b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.838+0000 7f9e40f91640 1 --2- 172.21.15.97:0/561837232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c09e170 0x7f9e3c123b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.838+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 shutdown_connections 2024-09-11T14:10:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.838+0000 7f9e40f91640 1 --2- 172.21.15.97:0/561837232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e3c09e170 0x7f9e3c123b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.838+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 >> 172.21.15.97:0/561837232 conn(0x7f9e3c06f850 msgr2=0x7f9e3c0a42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.838+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 shutdown_connections 2024-09-11T14:10:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:50.838+0000 7f9e40f91640 1 -- 172.21.15.97:0/561837232 wait complete. 2024-09-11T14:10:50.851 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T14:10:50.851 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T14:10:51.254 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:10:51.357 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.351+0000 7f248db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:51.401 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.356+0000 7f248db91640 1 Processor -- start 2024-09-11T14:10:51.401 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.356+0000 7f248db91640 1 -- start start 2024-09-11T14:10:51.401 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.357+0000 7f248db91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f248809f990 0x7f248809fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:51.401 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.357+0000 7f248db91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24880a8300 con 0x7f24880a02e0 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.357+0000 7f248db91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f24880a14b0 con 0x7f248809f990 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.357+0000 7f24877fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f248809f990 0x7f248809fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.357+0000 7f24877fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f248809f990 0x7f248809fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51210/0 (socket says 172.21.15.97:51210) 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.357+0000 7f24877fe640 1 -- 172.21.15.97:0/4099333993 learned_addr learned my addr 172.21.15.97:0/4099333993 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.357+0000 7f2486ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f24880a02e0 0x7f248813a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56014/0 (socket says 172.21.15.97:56014) 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.358+0000 7f24877fe640 1 -- 172.21.15.97:0/4099333993 >> v1:172.21.15.97:6789/0 conn(0x7f24880a02e0 legacy=0x7f248813a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.358+0000 7f24877fe640 1 -- 172.21.15.97:0/4099333993 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24880a1710 con 0x7f248809f990 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.358+0000 7f24867fc640 1 -- 172.21.15.97:0/4099333993 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496927873 0 0) 0x7f24880a8300 con 0x7f24880a02e0 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.358+0000 7f24877fe640 1 --2- 172.21.15.97:0/4099333993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f248809fda0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c482cab7bc0abd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.358+0000 7f24867fc640 1 -- 172.21.15.97:0/4099333993 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2478009e50 con 0x7f248809f990 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.358+0000 7f24867fc640 1 -- 172.21.15.97:0/4099333993 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f247800e230 con 0x7f248809f990 2024-09-11T14:10:51.402 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.358+0000 7f24867fc640 1 -- 172.21.15.97:0/4099333993 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f247800e4d0 con 0x7f248809f990 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 1 -- 172.21.15.97:0/4099333993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 msgr2=0x7f248809fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 1 --2- 172.21.15.97:0/4099333993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f248809fda0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 1 -- 172.21.15.97:0/4099333993 shutdown_connections 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 1 --2- 172.21.15.97:0/4099333993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f248809fda0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 1 -- 172.21.15.97:0/4099333993 >> 172.21.15.97:0/4099333993 conn(0x7f24880a6390 msgr2=0x7f24880a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 1 -- 172.21.15.97:0/4099333993 shutdown_connections 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 1 -- 172.21.15.97:0/4099333993 wait complete. 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.359+0000 7f248db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.361+0000 7f248db91640 1 Processor -- start 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.361+0000 7f248db91640 1 -- start start 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.362+0000 7f248db91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f24881bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.362+0000 7f248db91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f24881b80b0 con 0x7f248809f990 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.362+0000 7f24877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f24881bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:51.403 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.362+0000 7f24877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f24881bc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51224/0 (socket says 172.21.15.97:51224) 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.362+0000 7f24877fe640 1 -- 172.21.15.97:0/1118784242 learned_addr learned my addr 172.21.15.97:0/1118784242 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.362+0000 7f24877fe640 1 -- 172.21.15.97:0/1118784242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24881b8370 con 0x7f248809f990 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.362+0000 7f24877fe640 1 --2- 172.21.15.97:0/1118784242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f24881bc2e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.363+0000 7f246ffff640 1 -- 172.21.15.97:0/1118784242 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f247800ede0 con 0x7f248809f990 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.363+0000 7f246ffff640 1 -- 172.21.15.97:0/1118784242 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2478015420 con 0x7f248809f990 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.363+0000 7f246ffff640 1 -- 172.21.15.97:0/1118784242 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f24780156c0 con 0x7f248809f990 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.363+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24881b9ae0 con 0x7f248809f990 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.363+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24881ba900 con 0x7f248809f990 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.363+0000 7f246ffff640 1 -- 172.21.15.97:0/1118784242 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f2478015c00 con 0x7f248809f990 2024-09-11T14:10:51.404 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.363+0000 7f246ffff640 1 -- 172.21.15.97:0/1118784242 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f2478014db0 con 0x7f248809f990 2024-09-11T14:10:51.405 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.364+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24881bbf30 con 0x7f248809f990 2024-09-11T14:10:51.405 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.366+0000 7f246ffff640 1 -- 172.21.15.97:0/1118784242 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f2478011380 con 0x7f248809f990 2024-09-11T14:10:51.429 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.426+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24880a3980 con 0x7f248809f990 2024-09-11T14:10:51.429 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.427+0000 7f246ffff640 1 -- 172.21.15.97:0/1118784242 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f2478011520 con 0x7f248809f990 2024-09-11T14:10:51.429 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-11T14:10:51.430 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":7,"fsid":"f3855fa8-d59d-46b3-8802-359d51f9681f","created":"2024-09-11T14:10:48.224532+0000","modified":"2024-09-11T14:10:50.338674+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:10:50.338674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"22e03614-3c25-4e5f-9dcc-6ea59cce138b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2ff11a2-ef9b-4bd8-aaa9-73003208b30a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"40d2d04e-30e4-45e0-bbb5-a159d1eb2779","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b73e62e2-3d2b-4bf6-8961-2ea27b214707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:10:51.430 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.428+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 msgr2=0x7f24881bc2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:51.431 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.428+0000 7f248db91640 1 --2- 172.21.15.97:0/1118784242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f24881bc2e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:51.431 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.428+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 shutdown_connections 2024-09-11T14:10:51.431 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.428+0000 7f248db91640 1 --2- 172.21.15.97:0/1118784242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f248809f990 0x7f24881bc2e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:51.431 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.428+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 >> 172.21.15.97:0/1118784242 conn(0x7f24880a6390 msgr2=0x7f2488073220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:51.431 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.428+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 shutdown_connections 2024-09-11T14:10:51.431 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:51.428+0000 7f248db91640 1 -- 172.21.15.97:0/1118784242 wait complete. 2024-09-11T14:10:51.439 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-11T14:10:53.538 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-09-11T14:10:53.537+0000 7f1a3d0c4640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-11T14:10:57.843 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:10:57.950 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.945+0000 7f6b64893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:57.951 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.950+0000 7f6b64893640 1 Processor -- start 2024-09-11T14:10:57.951 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.950+0000 7f6b64893640 1 -- start start 2024-09-11T14:10:57.953 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.951+0000 7f6b64893640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b60072ae0 0x7f6b60072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:57.953 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.951+0000 7f6b64893640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6009dda0 con 0x7f6b60073430 2024-09-11T14:10:57.953 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.951+0000 7f6b64893640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6b60074d70 con 0x7f6b60072ae0 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b60072ae0 0x7f6b60072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5dd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6b60073430 0x7f6b60133e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56020/0 (socket says 172.21.15.97:56020) 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b60072ae0 0x7f6b60072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51236/0 (socket says 172.21.15.97:51236) 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5dd9b640 1 -- 172.21.15.97:0/2955990714 learned_addr learned my addr 172.21.15.97:0/2955990714 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5e59c640 1 -- 172.21.15.97:0/2955990714 >> v1:172.21.15.97:6789/0 conn(0x7f6b60073430 legacy=0x7f6b60133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5e59c640 1 -- 172.21.15.97:0/2955990714 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b60073f50 con 0x7f6b60072ae0 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5e59c640 1 --2- 172.21.15.97:0/2955990714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b60072ef0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c9bdf8a68b264f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5d59a640 1 -- 172.21.15.97:0/2955990714 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b50009d90 con 0x7f6b60072ae0 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5d59a640 1 -- 172.21.15.97:0/2955990714 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b5000e230 con 0x7f6b60072ae0 2024-09-11T14:10:57.954 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.952+0000 7f6b5d59a640 1 -- 172.21.15.97:0/2955990714 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b5000e4d0 con 0x7f6b60072ae0 2024-09-11T14:10:57.955 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 1 -- 172.21.15.97:0/2955990714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 msgr2=0x7f6b60072ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:57.955 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 1 --2- 172.21.15.97:0/2955990714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b60072ef0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:57.955 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 1 -- 172.21.15.97:0/2955990714 shutdown_connections 2024-09-11T14:10:57.956 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 1 --2- 172.21.15.97:0/2955990714 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b60072ef0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:57.956 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 1 -- 172.21.15.97:0/2955990714 >> 172.21.15.97:0/2955990714 conn(0x7f6b600a7100 msgr2=0x7f6b600a31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:57.956 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 1 -- 172.21.15.97:0/2955990714 shutdown_connections 2024-09-11T14:10:57.956 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 1 -- 172.21.15.97:0/2955990714 wait complete. 2024-09-11T14:10:57.956 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.953+0000 7f6b64893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:57.956 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.955+0000 7f6b64893640 1 Processor -- start 2024-09-11T14:10:57.956 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.955+0000 7f6b64893640 1 -- start start 2024-09-11T14:10:57.958 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.956+0000 7f6b64893640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b601220c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:57.958 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.956+0000 7f6b64893640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b601234f0 con 0x7f6b60072ae0 2024-09-11T14:10:57.958 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.956+0000 7f6b5e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b601220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:57.958 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.956+0000 7f6b5e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b601220c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51252/0 (socket says 172.21.15.97:51252) 2024-09-11T14:10:57.958 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.956+0000 7f6b5e59c640 1 -- 172.21.15.97:0/2687935936 learned_addr learned my addr 172.21.15.97:0/2687935936 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:57.959 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.956+0000 7f6b5e59c640 1 -- 172.21.15.97:0/2687935936 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b60121ac0 con 0x7f6b60072ae0 2024-09-11T14:10:57.959 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.957+0000 7f6b5e59c640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b601220c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:57.959 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.957+0000 7f6b4effd640 1 -- 172.21.15.97:0/2687935936 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b50014620 con 0x7f6b60072ae0 2024-09-11T14:10:57.959 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.957+0000 7f6b4effd640 1 -- 172.21.15.97:0/2687935936 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b50014780 con 0x7f6b60072ae0 2024-09-11T14:10:57.959 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.957+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b60121d20 con 0x7f6b60072ae0 2024-09-11T14:10:57.959 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.957+0000 7f6b4effd640 1 -- 172.21.15.97:0/2687935936 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b50014a20 con 0x7f6b60072ae0 2024-09-11T14:10:57.959 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.957+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b60124d90 con 0x7f6b60072ae0 2024-09-11T14:10:57.960 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.958+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b60125860 con 0x7f6b60072ae0 2024-09-11T14:10:57.960 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.958+0000 7f6b4effd640 1 -- 172.21.15.97:0/2687935936 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f6b50014b80 con 0x7f6b60072ae0 2024-09-11T14:10:57.960 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.958+0000 7f6b4effd640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f6b4003e8a0 0x7f6b40040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:57.960 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.958+0000 7f6b4effd640 1 -- 172.21.15.97:0/2687935936 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 2308+0+0 (crc 0 0 0) 0x7f6b50019040 con 0x7f6b60072ae0 2024-09-11T14:10:57.960 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.959+0000 7f6b5dd9b640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f6b4003e8a0 0x7f6b40040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:57.960 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.959+0000 7f6b5dd9b640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f6b4003e8a0 0x7f6b40040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:57.965 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:57.964+0000 7f6b4effd640 1 -- 172.21.15.97:0/2687935936 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6b50011380 con 0x7f6b60072ae0 2024-09-11T14:10:58.142 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.141+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b600a3e70 con 0x7f6b60072ae0 2024-09-11T14:10:58.143 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.142+0000 7f6b4effd640 1 -- 172.21.15.97:0/2687935936 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+6962 (crc 0 0 0) 0x7f6b50018190 con 0x7f6b60072ae0 2024-09-11T14:10:58.143 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-11T14:10:58.143 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":10,"fsid":"f3855fa8-d59d-46b3-8802-359d51f9681f","created":"2024-09-11T14:10:48.224532+0000","modified":"2024-09-11T14:10:57.546724+0000","last_up_change":"2024-09-11T14:10:55.538592+0000","last_in_change":"2024-09-11T14:10:50.338674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:10:56.553117+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22e03614-3c25-4e5f-9dcc-6ea59cce138b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6801","nonce":2470268139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2470268139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6805","nonce":2470268139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2470268139}]},"public_addr":"172.21.15.97:6801/2470268139","cluster_addr":"172.21.15.97:6800/2470268139","heartbeat_back_addr":"172.21.15.97:6805/2470268139","heartbeat_front_addr":"172.21.15.97:6802/2470268139","state":["exists","up"]},{"osd":1,"uuid":"d2ff11a2-ef9b-4bd8-aaa9-73003208b30a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1629092190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1629092190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1629092190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1629092190}]},"public_addr":"172.21.15.97:6804/1629092190","cluster_addr":"172.21.15.97:6803/1629092190","heartbeat_back_addr":"172.21.15.97:6807/1629092190","heartbeat_front_addr":"172.21.15.97:6808/1629092190","state":["exists","up"]},{"osd":2,"uuid":"40d2d04e-30e4-45e0-bbb5-a159d1eb2779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":2173725438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2173725438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2173725438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":2173725438}]},"public_addr":"172.21.15.117:6811/2173725438","cluster_addr":"172.21.15.117:6810/2173725438","heartbeat_back_addr":"172.21.15.117:6806/2173725438","heartbeat_front_addr":"172.21.15.117:6803/2173725438","state":["exists","up"]},{"osd":3,"uuid":"b73e62e2-3d2b-4bf6-8961-2ea27b214707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":4196478755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":4196478755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":4196478755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":4196478755}]},"public_addr":"172.21.15.117:6808/4196478755","cluster_addr":"172.21.15.117:6807/4196478755","heartbeat_back_addr":"172.21.15.117:6805/4196478755","heartbeat_front_addr":"172.21.15.117:6804/4196478755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f6b4003e8a0 msgr2=0x7f6b40040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f6b4003e8a0 0x7f6b40040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 msgr2=0x7f6b601220c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b601220c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 shutdown_connections 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f6b4003e8a0 0x7f6b40040db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 --2- 172.21.15.97:0/2687935936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60072ae0 0x7f6b601220c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 >> 172.21.15.97:0/2687935936 conn(0x7f6b600a7100 msgr2=0x7f6b6009fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 shutdown_connections 2024-09-11T14:10:58.146 INFO:teuthology.misc.health.smithi097.stderr:2024-09-11T14:10:58.144+0000 7f6b64893640 1 -- 172.21.15.97:0/2687935936 wait complete. 2024-09-11T14:10:58.155 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-11T14:10:58.155 INFO:tasks.ceph:Creating RBD pool 2024-09-11T14:10:58.155 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T14:10:58.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.254+0000 7f1525f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:58.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.263+0000 7f1525f11640 1 Processor -- start 2024-09-11T14:10:58.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.263+0000 7f1525f11640 1 -- start start 2024-09-11T14:10:58.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.264+0000 7f1525f11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f152009fa70 0x7f152009fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:58.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.264+0000 7f1525f11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15200a1f80 con 0x7f15200a03c0 2024-09-11T14:10:58.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.264+0000 7f1525f11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f152006f150 con 0x7f152009fa70 2024-09-11T14:10:58.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.264+0000 7f151f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f152009fa70 0x7f152009fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:58.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.264+0000 7f151effd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f15200a03c0 0x7f1520133d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56028/0 (socket says 172.21.15.97:56028) 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.264+0000 7f151f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f152009fa70 0x7f152009fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51266/0 (socket says 172.21.15.97:51266) 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.264+0000 7f151effd640 1 -- 172.21.15.97:0/2797218254 learned_addr learned my addr 172.21.15.97:0/2797218254 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.265+0000 7f151f7fe640 1 -- 172.21.15.97:0/2797218254 >> v1:172.21.15.97:6789/0 conn(0x7f15200a03c0 legacy=0x7f1520133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.265+0000 7f151f7fe640 1 -- 172.21.15.97:0/2797218254 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520071570 con 0x7f152009fa70 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.265+0000 7f151f7fe640 1 --2- 172.21.15.97:0/2797218254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f152009fe80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd409349800ca32f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.265+0000 7f151e7fc640 1 -- 172.21.15.97:0/2797218254 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1510009d80 con 0x7f152009fa70 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.265+0000 7f151e7fc640 1 -- 172.21.15.97:0/2797218254 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f151000e230 con 0x7f152009fa70 2024-09-11T14:10:58.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.265+0000 7f151e7fc640 1 -- 172.21.15.97:0/2797218254 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f151000e4d0 con 0x7f152009fa70 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 1 -- 172.21.15.97:0/2797218254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 msgr2=0x7f152009fe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 1 --2- 172.21.15.97:0/2797218254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f152009fe80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 1 -- 172.21.15.97:0/2797218254 shutdown_connections 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 1 --2- 172.21.15.97:0/2797218254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f152009fe80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 1 -- 172.21.15.97:0/2797218254 >> 172.21.15.97:0/2797218254 conn(0x7f15200a3390 msgr2=0x7f15200a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 1 -- 172.21.15.97:0/2797218254 shutdown_connections 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 1 -- 172.21.15.97:0/2797218254 wait complete. 2024-09-11T14:10:58.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.266+0000 7f1525f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:58.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.267+0000 7f1525f11640 1 Processor -- start 2024-09-11T14:10:58.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.267+0000 7f1525f11640 1 -- start start 2024-09-11T14:10:58.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.268+0000 7f1525f11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f15201338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:58.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.268+0000 7f1525f11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f15201340e0 con 0x7f152009fa70 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f151f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f15201338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f151f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f15201338b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51280/0 (socket says 172.21.15.97:51280) 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f151f7fe640 1 -- 172.21.15.97:0/1710862265 learned_addr learned my addr 172.21.15.97:0/1710862265 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f151f7fe640 1 -- 172.21.15.97:0/1710862265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520121280 con 0x7f152009fa70 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f151f7fe640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f15201338b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f1507fff640 1 -- 172.21.15.97:0/1710862265 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1510014540 con 0x7f152009fa70 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f1507fff640 1 -- 172.21.15.97:0/1710862265 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f15100146a0 con 0x7f152009fa70 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1520120c30 con 0x7f152009fa70 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f1507fff640 1 -- 172.21.15.97:0/1710862265 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1510014940 con 0x7f152009fa70 2024-09-11T14:10:58.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.269+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1520122c20 con 0x7f152009fa70 2024-09-11T14:10:58.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.270+0000 7f1507fff640 1 -- 172.21.15.97:0/1710862265 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f1510014af0 con 0x7f152009fa70 2024-09-11T14:10:58.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.270+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15200a40e0 con 0x7f152009fa70 2024-09-11T14:10:58.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.270+0000 7f1507fff640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f150c03e8a0 0x7f150c040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:58.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.270+0000 7f1507fff640 1 -- 172.21.15.97:0/1710862265 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 2308+0+0 (crc 0 0 0) 0x7f1510019040 con 0x7f152009fa70 2024-09-11T14:10:58.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.271+0000 7f151effd640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f150c03e8a0 0x7f150c040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:58.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.271+0000 7f151effd640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f150c03e8a0 0x7f150c040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:58.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.276+0000 7f1507fff640 1 -- 172.21.15.97:0/1710862265 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1510018790 con 0x7f152009fa70 2024-09-11T14:10:58.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.451+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f15201236d0 con 0x7f152009fa70 2024-09-11T14:10:58.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.550+0000 7f1507fff640 1 -- 172.21.15.97:0/1710862265 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) ==== 109+0+0 (crc 0 0 0) 0x7f151000f2a0 con 0x7f152009fa70 2024-09-11T14:10:58.552 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'rbd' created 2024-09-11T14:10:58.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f150c03e8a0 msgr2=0x7f150c040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f150c03e8a0 0x7f150c040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 msgr2=0x7f15201338b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f15201338b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 shutdown_connections 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f150c03e8a0 0x7f150c040db0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 --2- 172.21.15.97:0/1710862265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f152009fa70 0x7f15201338b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 >> 172.21.15.97:0/1710862265 conn(0x7f15200a3390 msgr2=0x7f152009ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 shutdown_connections 2024-09-11T14:10:58.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.554+0000 7f1525f11640 1 -- 172.21.15.97:0/1710862265 wait complete. 2024-09-11T14:10:58.570 DEBUG:teuthology.orchestra.run.smithi097:> rbd --cluster ceph pool init rbd 2024-09-11T14:10:58.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.755+0000 7f4403c3eac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:58.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.755+0000 7f4403c3eac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:58.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.756+0000 7f4403c3eac0 1 Processor -- start 2024-09-11T14:10:58.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.757+0000 7f4403c3eac0 1 -- start start 2024-09-11T14:10:58.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f4403c3eac0 1 --2- >> v2:172.21.15.97:3300/0 conn(0x24f9650 0x258f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:58.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f4403c3eac0 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x235a180 con 0x24f9ea0 2024-09-11T14:10:58.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f4403c3eac0 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x2399b90 con 0x24f9650 2024-09-11T14:10:58.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f43fd614640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x24f9650 0x258f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:58.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f43fde15640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x24f9ea0 0x258f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56032/0 (socket says 172.21.15.97:56032) 2024-09-11T14:10:58.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f43fd614640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x24f9650 0x258f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51284/0 (socket says 172.21.15.97:51284) 2024-09-11T14:10:58.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f43fde15640 1 -- 172.21.15.97:0/3737438987 learned_addr learned my addr 172.21.15.97:0/3737438987 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:10:58.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f43fd614640 1 -- 172.21.15.97:0/3737438987 >> v1:172.21.15.97:6789/0 conn(0x24f9ea0 legacy=0x258f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f43fce13640 1 -- 172.21.15.97:0/3737438987 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371764185 0 0) 0x235a180 con 0x24f9ea0 2024-09-11T14:10:58.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.758+0000 7f43fd614640 1 -- 172.21.15.97:0/3737438987 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x232ff80 con 0x24f9650 2024-09-11T14:10:58.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.759+0000 7f43fd614640 1 --2- 172.21.15.97:0/3737438987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258f8d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a36d005007d816 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:58.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.759+0000 7f43fce13640 1 -- 172.21.15.97:0/3737438987 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43ec02d760 con 0x24f9650 2024-09-11T14:10:58.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.759+0000 7f43fce13640 1 -- 172.21.15.97:0/3737438987 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43ec02d8c0 con 0x24f9650 2024-09-11T14:10:58.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f43fce13640 1 -- 172.21.15.97:0/3737438987 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43ec02db60 con 0x24f9650 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f4403c3eac0 1 -- 172.21.15.97:0/3737438987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 msgr2=0x258f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/3737438987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258f8d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f4403c3eac0 1 -- 172.21.15.97:0/3737438987 shutdown_connections 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/3737438987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258f8d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f4403c3eac0 1 -- 172.21.15.97:0/3737438987 >> 172.21.15.97:0/3737438987 conn(0x2302f70 msgr2=0x24f36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f4403c3eac0 1 -- 172.21.15.97:0/3737438987 shutdown_connections 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.760+0000 7f4403c3eac0 1 -- 172.21.15.97:0/3737438987 wait complete. 2024-09-11T14:10:58.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.761+0000 7f4403c3eac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:10:58.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.762+0000 7f4403c3eac0 1 Processor -- start 2024-09-11T14:10:58.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.762+0000 7f4403c3eac0 1 -- start start 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.763+0000 7f4403c3eac0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.763+0000 7f4403c3eac0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x23a48f0 con 0x24f9650 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.763+0000 7f43fde15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.763+0000 7f43fde15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51286/0 (socket says 172.21.15.97:51286) 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.763+0000 7f43fde15640 1 -- 172.21.15.97:0/907916728 learned_addr learned my addr 172.21.15.97:0/907916728 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.763+0000 7f43fde15640 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x233e800 con 0x24f9650 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.763+0000 7f43fde15640 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258c6e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:58.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.764+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43f400d3d0 con 0x24f9650 2024-09-11T14:10:58.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.764+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43f400d530 con 0x24f9650 2024-09-11T14:10:58.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.764+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2330310 con 0x24f9650 2024-09-11T14:10:58.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.764+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43f400d7d0 con 0x24f9650 2024-09-11T14:10:58.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.764+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x232fd70 con 0x24f9650 2024-09-11T14:10:58.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.765+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f43f400d980 con 0x24f9650 2024-09-11T14:10:58.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.765+0000 7f43e9ffb640 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43dc03d130 0x7f43dc03f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:58.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.765+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2661+0+0 (crc 0 0 0) 0x7f43f404ec30 con 0x24f9650 2024-09-11T14:10:58.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.765+0000 7f43fd614640 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43dc03d130 0x7f43dc03f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:10:58.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.765+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x257bce0 con 0x24f9650 2024-09-11T14:10:58.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:58.766+0000 7f43fd614640 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43dc03d130 0x7f43dc03f640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:59.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.557+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v12) ==== 141+0+0 (crc 0 0 0) 0x7f43f40043f0 con 0x24f9650 2024-09-11T14:10:59.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.557+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x2357520 con 0x24f9650 2024-09-11T14:10:59.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.562+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (crc 0 0 0) 0x7f43f4007e80 con 0x24f9650 2024-09-11T14:10:59.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.562+0000 7f43ebfff640 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=12}) -- 0x7f43d8002ae0 con 0x24f9650 2024-09-11T14:10:59.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.562+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(12..12 src has 1..12) ==== 1028+0+0 (crc 0 0 0) 0x7f43f4008de0 con 0x24f9650 2024-09-11T14:10:59.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.563+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6804/1629092190 conn(0x257b3e0 0x25a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:59.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.563+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12) -- 0x257b7f0 con 0x257b3e0 2024-09-11T14:10:59.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.567+0000 7f43ff077640 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6804/1629092190 conn(0x257b3e0 0x25a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:10:59.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.636+0000 7f43ff077640 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6804/1629092190 conn(0x257b3e0 0x25a2230 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:59.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.651+0000 7f43ff077640 1 -- 172.21.15.97:0/907916728 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== osd_op_reply(1 rbd_trash [create] v12'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f43f000a4b0 con 0x257b3e0 2024-09-11T14:10:59.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.654+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6801/2470268139 conn(0x25f5250 0x25f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:10:59.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.654+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e12) -- 0x25f7d00 con 0x25f5250 2024-09-11T14:10:59.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.655+0000 7f43fde15640 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6801/2470268139 conn(0x25f5250 0x25f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:10:59.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.658+0000 7f43fde15640 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6801/2470268139 conn(0x25f5250 0x25f7730 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:10:59.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.662+0000 7f43fde15640 1 -- 172.21.15.97:0/907916728 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f43f400dc80 con 0x25f5250 2024-09-11T14:10:59.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.663+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e12) -- 0x25f4710 con 0x25f5250 2024-09-11T14:10:59.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.666+0000 7f43fde15640 1 -- 172.21.15.97:0/907916728 <== osd.0 v2:172.21.15.97:6801/2470268139 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f43f400dc80 con 0x25f5250 2024-09-11T14:10:59.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:10:59.666+0000 7f43eb7fe640 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f43d0001f60 con 0x24f9650 2024-09-11T14:11:00.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:00.574+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f43f4020ed0 con 0x24f9650 2024-09-11T14:11:00.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:00.577+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v13) ==== 55+0+0 (crc 0 0 0) 0x7f43f401fd10 con 0x24f9650 2024-09-11T14:11:00.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:00.577+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7f43dc042aa0 con 0x24f9650 2024-09-11T14:11:00.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:00.577+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 11 ==== osd_map(13..13 src has 1..13) ==== 626+0+0 (crc 0 0 0) 0x7f43f4026040 con 0x24f9650 2024-09-11T14:11:00.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:00.578+0000 7f43ebfff640 1 -- 172.21.15.97:0/907916728 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0x7f43d8005640 con 0x25f5250 2024-09-11T14:11:00.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:00.605+0000 7f43fde15640 1 -- 172.21.15.97:0/907916728 <== osd.0 v2:172.21.15.97:6801/2470268139 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v13'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f43f400dc80 con 0x25f5250 2024-09-11T14:11:00.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:00.605+0000 7f43eb7fe640 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v13) -- 0x7f43d0003370 con 0x24f9650 2024-09-11T14:11:01.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.574+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v14) ==== 43+0+0 (crc 0 0 0) 0x7f43f40084e0 con 0x24f9650 2024-09-11T14:11:01.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.574+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f43dc042c30 con 0x24f9650 2024-09-11T14:11:01.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.574+0000 7f43e9ffb640 1 -- 172.21.15.97:0/907916728 <== mon.0 v2:172.21.15.97:3300/0 13 ==== osd_map(14..14 src has 1..14) ==== 654+0+0 (crc 0 0 0) 0x7f43f40075d0 con 0x24f9650 2024-09-11T14:11:01.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.574+0000 7f43ebfff640 1 -- 172.21.15.97:0/907916728 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7f43d80059e0 con 0x25f5250 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f43fde15640 1 -- 172.21.15.97:0/907916728 <== osd.0 v2:172.21.15.97:6801/2470268139 4 ==== osd_op_reply(7 rbd_info [write 0~19] v14'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f400dc80 con 0x25f5250 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6801/2470268139 conn(0x25f5250 msgr2=0x25f7730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6801/2470268139 conn(0x25f5250 0x25f7730 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6804/1629092190 conn(0x257b3e0 msgr2=0x25a2230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6804/1629092190 conn(0x257b3e0 0x25a2230 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43dc03d130 msgr2=0x7f43dc03f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43dc03d130 0x7f43dc03f640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 msgr2=0x258c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258c6e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 shutdown_connections 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6801/2470268139 conn(0x25f5250 0x25f7730 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> v2:172.21.15.97:6804/1629092190 conn(0x257b3e0 0x25a2230 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43dc03d130 0x7f43dc03f640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 --2- 172.21.15.97:0/907916728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x24f9650 0x258c6e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 >> 172.21.15.97:0/907916728 conn(0x2302f70 msgr2=0x24fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 shutdown_connections 2024-09-11T14:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.603+0000 7f4403c3eac0 1 -- 172.21.15.97:0/907916728 wait complete. 2024-09-11T14:11:01.609 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T14:11:01.610 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T14:11:01.610 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T14:11:01.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.717+0000 7fc4f7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:01.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.723+0000 7fc4f7791640 1 Processor -- start 2024-09-11T14:11:01.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.723+0000 7fc4f7791640 1 -- start start 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f7791640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4f009d570 0x7fc4f013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f7791640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f00a0060 con 0x7fc4f009ca50 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f7791640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f009fd30 con 0x7fc4f009d570 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f552d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc4f009ca50 0x7fc4f009ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55408/0 (socket says 172.21.15.97:55408) 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f4d2c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc4f009d570 0x7fc4f013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f552d640 1 -- 172.21.15.97:0/1730034359 learned_addr learned my addr 172.21.15.97:0/1730034359 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f4d2c640 1 -- 172.21.15.97:0/1730034359 >> v1:172.21.15.97:6789/0 conn(0x7fc4f009ca50 legacy=0x7fc4f009ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f4d2c640 1 -- 172.21.15.97:0/1730034359 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f009e3c0 con 0x7fc4f009d570 2024-09-11T14:11:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.724+0000 7fc4f4d2c640 1 --2- 172.21.15.97:0/1730034359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009d570 0x7fc4f013b3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfb449cdec0ec09 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4effff640 1 -- 172.21.15.97:0/1730034359 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc4e4009d80 con 0x7fc4f009d570 2024-09-11T14:11:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4effff640 1 -- 172.21.15.97:0/1730034359 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc4e400e230 con 0x7fc4f009d570 2024-09-11T14:11:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4effff640 1 -- 172.21.15.97:0/1730034359 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc4e400e4d0 con 0x7fc4f009d570 2024-09-11T14:11:01.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4f7791640 1 -- 172.21.15.97:0/1730034359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009d570 msgr2=0x7fc4f013b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4f7791640 1 --2- 172.21.15.97:0/1730034359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009d570 0x7fc4f013b3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4f7791640 1 -- 172.21.15.97:0/1730034359 shutdown_connections 2024-09-11T14:11:01.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4f7791640 1 --2- 172.21.15.97:0/1730034359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009d570 0x7fc4f013b3b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4f7791640 1 -- 172.21.15.97:0/1730034359 >> 172.21.15.97:0/1730034359 conn(0x7fc4f00a5230 msgr2=0x7fc4f00a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:01.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4f7791640 1 -- 172.21.15.97:0/1730034359 shutdown_connections 2024-09-11T14:11:01.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.725+0000 7fc4f7791640 1 -- 172.21.15.97:0/1730034359 wait complete. 2024-09-11T14:11:01.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.726+0000 7fc4f7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:01.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.727+0000 7fc4f7791640 1 Processor -- start 2024-09-11T14:11:01.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.727+0000 7fc4f7791640 1 -- start start 2024-09-11T14:11:01.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4f7791640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009ca50 0x7fc4f0122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:01.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4f7791640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0124200 con 0x7fc4f009ca50 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4f552d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009ca50 0x7fc4f0122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4f552d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009ca50 0x7fc4f0122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59220/0 (socket says 172.21.15.97:59220) 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4f552d640 1 -- 172.21.15.97:0/3617692968 learned_addr learned my addr 172.21.15.97:0/3617692968 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4f552d640 1 -- 172.21.15.97:0/3617692968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f0126ce0 con 0x7fc4f009ca50 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4f552d640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009ca50 0x7fc4f0122d60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.728+0000 7fc4edffb640 1 -- 172.21.15.97:0/3617692968 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc4e0005a60 con 0x7fc4f009ca50 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.729+0000 7fc4edffb640 1 -- 172.21.15.97:0/3617692968 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc4e0005bc0 con 0x7fc4f009ca50 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.729+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f01269b0 con 0x7fc4f009ca50 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.729+0000 7fc4edffb640 1 -- 172.21.15.97:0/3617692968 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc4e0005e60 con 0x7fc4f009ca50 2024-09-11T14:11:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.729+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f0126610 con 0x7fc4f009ca50 2024-09-11T14:11:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.730+0000 7fc4edffb640 1 -- 172.21.15.97:0/3617692968 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc4e00070b0 con 0x7fc4f009ca50 2024-09-11T14:11:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.730+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f0125110 con 0x7fc4f009ca50 2024-09-11T14:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.730+0000 7fc4edffb640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc4dc03e960 0x7fc4dc040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.730+0000 7fc4edffb640 1 -- 172.21.15.97:0/3617692968 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7fc4e004f630 con 0x7fc4f009ca50 2024-09-11T14:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.731+0000 7fc4f4d2c640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc4dc03e960 0x7fc4dc040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.731+0000 7fc4f4d2c640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc4dc03e960 0x7fc4dc040e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.735+0000 7fc4edffb640 1 -- 172.21.15.97:0/3617692968 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc4e000dc60 con 0x7fc4f009ca50 2024-09-11T14:11:01.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.910+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fc4f009ce60 con 0x7fc4f009ca50 2024-09-11T14:11:01.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.911+0000 7fc4edffb640 1 -- 172.21.15.97:0/3617692968 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7fc4e000d660 con 0x7fc4f009ca50 2024-09-11T14:11:01.912 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:11:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.913+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc4dc03e960 msgr2=0x7fc4dc040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.913+0000 7fc4f7791640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc4dc03e960 0x7fc4dc040e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.913+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009ca50 msgr2=0x7fc4f0122d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.913+0000 7fc4f7791640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009ca50 0x7fc4f0122d60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.914+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 shutdown_connections 2024-09-11T14:11:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.914+0000 7fc4f7791640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc4dc03e960 0x7fc4dc040e70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.914+0000 7fc4f7791640 1 --2- 172.21.15.97:0/3617692968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4f009ca50 0x7fc4f0122d60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:01.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.914+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 >> 172.21.15.97:0/3617692968 conn(0x7fc4f00a5230 msgr2=0x7fc4f00a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:01.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.914+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 shutdown_connections 2024-09-11T14:11:01.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:01.914+0000 7fc4f7791640 1 -- 172.21.15.97:0/3617692968 wait complete. 2024-09-11T14:11:01.927 INFO:teuthology.orchestra.run.smithi097.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-11T14:11:01.927 INFO:tasks.ceph_manager:config epoch is 1 2024-09-11T14:11:01.928 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T14:11:01.928 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T14:11:01.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T14:11:02.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.030+0000 7f2fcf391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:02.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.035+0000 7f2fcf391640 1 Processor -- start 2024-09-11T14:11:02.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.035+0000 7f2fcf391640 1 -- start start 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcf391640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2fc809e910 0x7f2fc8069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcf391640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc806d370 con 0x7f2fc809f040 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcf391640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc8070cb0 con 0x7f2fc809e910 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcc92c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2fc809e910 0x7f2fc8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcd12d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2fc809f040 0x7f2fc8068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55422/0 (socket says 172.21.15.97:55422) 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcc92c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2fc809e910 0x7f2fc8069450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59234/0 (socket says 172.21.15.97:59234) 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcd12d640 1 -- 172.21.15.97:0/115963004 learned_addr learned my addr 172.21.15.97:0/115963004 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcc92c640 1 -- 172.21.15.97:0/115963004 >> v1:172.21.15.97:6789/0 conn(0x7f2fc809f040 legacy=0x7f2fc8068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcc92c640 1 -- 172.21.15.97:0/115963004 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc809c1c0 con 0x7f2fc809e910 2024-09-11T14:11:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fcc92c640 1 --2- 172.21.15.97:0/115963004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8069450 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6b4b8fb2b1fc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fbffff640 1 -- 172.21.15.97:0/115963004 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fb8009d90 con 0x7f2fc809e910 2024-09-11T14:11:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fbffff640 1 -- 172.21.15.97:0/115963004 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fb800e230 con 0x7f2fc809e910 2024-09-11T14:11:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.037+0000 7f2fbffff640 1 -- 172.21.15.97:0/115963004 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fb800e4d0 con 0x7f2fc809e910 2024-09-11T14:11:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.038+0000 7f2fcf391640 1 -- 172.21.15.97:0/115963004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 msgr2=0x7f2fc8069450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.038+0000 7f2fcf391640 1 --2- 172.21.15.97:0/115963004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8069450 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.038+0000 7f2fcf391640 1 -- 172.21.15.97:0/115963004 shutdown_connections 2024-09-11T14:11:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.038+0000 7f2fcf391640 1 --2- 172.21.15.97:0/115963004 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8069450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.038+0000 7f2fcf391640 1 -- 172.21.15.97:0/115963004 >> 172.21.15.97:0/115963004 conn(0x7f2fc80a32a0 msgr2=0x7f2fc80a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.039+0000 7f2fcf391640 1 -- 172.21.15.97:0/115963004 shutdown_connections 2024-09-11T14:11:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.039+0000 7f2fcf391640 1 -- 172.21.15.97:0/115963004 wait complete. 2024-09-11T14:11:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.039+0000 7f2fcf391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:02.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.040+0000 7f2fcf391640 1 Processor -- start 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.040+0000 7f2fcf391640 1 -- start start 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.041+0000 7f2fcf391640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8130420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.041+0000 7f2fcf391640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc8131d20 con 0x7f2fc809e910 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.041+0000 7f2fcd12d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.041+0000 7f2fcd12d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8130420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59250/0 (socket says 172.21.15.97:59250) 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.041+0000 7f2fcd12d640 1 -- 172.21.15.97:0/1176418949 learned_addr learned my addr 172.21.15.97:0/1176418949 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.042+0000 7f2fcd12d640 1 -- 172.21.15.97:0/1176418949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc8133ce0 con 0x7f2fc809e910 2024-09-11T14:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.042+0000 7f2fcd12d640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8130420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.042+0000 7f2fbdffb640 1 -- 172.21.15.97:0/1176418949 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fc4005a60 con 0x7f2fc809e910 2024-09-11T14:11:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.042+0000 7f2fbdffb640 1 -- 172.21.15.97:0/1176418949 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fc4005bc0 con 0x7f2fc809e910 2024-09-11T14:11:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.042+0000 7f2fbdffb640 1 -- 172.21.15.97:0/1176418949 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fc4005e60 con 0x7f2fc809e910 2024-09-11T14:11:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.042+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc8132570 con 0x7f2fc809e910 2024-09-11T14:11:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.042+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc8133760 con 0x7f2fc809e910 2024-09-11T14:11:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.043+0000 7f2fbdffb640 1 -- 172.21.15.97:0/1176418949 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2fc400c7f0 con 0x7f2fc809e910 2024-09-11T14:11:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.043+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc8134170 con 0x7f2fc809e910 2024-09-11T14:11:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.043+0000 7f2fbdffb640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2fac03e930 0x7f2fac040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.043+0000 7f2fbdffb640 1 -- 172.21.15.97:0/1176418949 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f2fc404f6c0 con 0x7f2fc809e910 2024-09-11T14:11:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.044+0000 7f2fcc92c640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2fac03e930 0x7f2fac040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.044+0000 7f2fcc92c640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2fac03e930 0x7f2fac040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.049+0000 7f2fbdffb640 1 -- 172.21.15.97:0/1176418949 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2fc400dc10 con 0x7f2fc809e910 2024-09-11T14:11:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.267+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2fc8068d40 con 0x7f2fc809e910 2024-09-11T14:11:02.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.269+0000 7f2fbdffb640 1 -- 172.21.15.97:0/1176418949 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97906 (crc 0 0 0) 0x7f2fc400d610 con 0x7f2fc809e910 2024-09-11T14:11:02.275 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:11:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2fac03e930 msgr2=0x7f2fac040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2fac03e930 0x7f2fac040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 msgr2=0x7f2fc8130420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8130420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 shutdown_connections 2024-09-11T14:11:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2fac03e930 0x7f2fac040e40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 --2- 172.21.15.97:0/1176418949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fc809e910 0x7f2fc8130420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 >> 172.21.15.97:0/1176418949 conn(0x7f2fc80a32a0 msgr2=0x7f2fc809fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 shutdown_connections 2024-09-11T14:11:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.272+0000 7f2fcf391640 1 -- 172.21.15.97:0/1176418949 wait complete. 2024-09-11T14:11:02.284 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3188360781},{"type":"v1","addr":"172.21.15.117:6801","nonce":3188360781}]},"active_addr":"172.21.15.117:6801/3188360781","active_change":"2024-09-11T14:10:52.527219+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":966639665}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":937805144}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":4038017374}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3345371024}]}]} 2024-09-11T14:11:02.288 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T14:11:02.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T14:11:02.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:11:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.392+0000 7f0f13f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.396+0000 7f0f13f91640 1 Processor -- start 2024-09-11T14:11:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.397+0000 7f0f13f91640 1 -- start start 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f13f91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f0c09d570 0x7f0f0c13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f13f91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f0c0a0060 con 0x7f0f0c09ca50 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f13f91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0c09fd30 con 0x7f0f0c09d570 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f1152c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f0c09d570 0x7f0f0c13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f11d2d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0f0c09ca50 0x7f0f0c09ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55438/0 (socket says 172.21.15.97:55438) 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f1152c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f0c09d570 0x7f0f0c13b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59256/0 (socket says 172.21.15.97:59256) 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f11d2d640 1 -- 172.21.15.97:0/296208331 learned_addr learned my addr 172.21.15.97:0/296208331 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f1152c640 1 -- 172.21.15.97:0/296208331 >> v1:172.21.15.97:6789/0 conn(0x7f0f0c09ca50 legacy=0x7f0f0c09ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f1152c640 1 -- 172.21.15.97:0/296208331 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c09e3c0 con 0x7f0f0c09d570 2024-09-11T14:11:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f1152c640 1 --2- 172.21.15.97:0/296208331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09d570 0x7f0f0c13b3b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83877420d596855a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f10d2b640 1 -- 172.21.15.97:0/296208331 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0efc009d80 con 0x7f0f0c09d570 2024-09-11T14:11:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.398+0000 7f0f10d2b640 1 -- 172.21.15.97:0/296208331 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0efc00e230 con 0x7f0f0c09d570 2024-09-11T14:11:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f10d2b640 1 -- 172.21.15.97:0/296208331 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0efc00e4d0 con 0x7f0f0c09d570 2024-09-11T14:11:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f13f91640 1 -- 172.21.15.97:0/296208331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09d570 msgr2=0x7f0f0c13b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f13f91640 1 --2- 172.21.15.97:0/296208331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09d570 0x7f0f0c13b3b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f13f91640 1 -- 172.21.15.97:0/296208331 shutdown_connections 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f13f91640 1 --2- 172.21.15.97:0/296208331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09d570 0x7f0f0c13b3b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f13f91640 1 -- 172.21.15.97:0/296208331 >> 172.21.15.97:0/296208331 conn(0x7f0f0c0a5230 msgr2=0x7f0f0c0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f13f91640 1 -- 172.21.15.97:0/296208331 shutdown_connections 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.399+0000 7f0f13f91640 1 -- 172.21.15.97:0/296208331 wait complete. 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.400+0000 7f0f13f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:02.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.401+0000 7f0f13f91640 1 Processor -- start 2024-09-11T14:11:02.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.401+0000 7f0f13f91640 1 -- start start 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f13f91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09ca50 0x7f0f0c122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f13f91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c124260 con 0x7f0f0c09ca50 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f11d2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09ca50 0x7f0f0c122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f11d2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09ca50 0x7f0f0c122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59258/0 (socket says 172.21.15.97:59258) 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f11d2d640 1 -- 172.21.15.97:0/3444738671 learned_addr learned my addr 172.21.15.97:0/3444738671 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f11d2d640 1 -- 172.21.15.97:0/3444738671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c126cf0 con 0x7f0f0c09ca50 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f11d2d640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09ca50 0x7f0f0c122dc0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f027fc640 1 -- 172.21.15.97:0/3444738671 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f08005a60 con 0x7f0f0c09ca50 2024-09-11T14:11:02.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f027fc640 1 -- 172.21.15.97:0/3444738671 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f08005bc0 con 0x7f0f0c09ca50 2024-09-11T14:11:02.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.402+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c1269c0 con 0x7f0f0c09ca50 2024-09-11T14:11:02.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.403+0000 7f0f027fc640 1 -- 172.21.15.97:0/3444738671 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f08005e60 con 0x7f0f0c09ca50 2024-09-11T14:11:02.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.403+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c126620 con 0x7f0f0c09ca50 2024-09-11T14:11:02.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.403+0000 7f0f027fc640 1 -- 172.21.15.97:0/3444738671 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0f080070b0 con 0x7f0f0c09ca50 2024-09-11T14:11:02.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.403+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c125120 con 0x7f0f0c09ca50 2024-09-11T14:11:02.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.404+0000 7f0f027fc640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0ef003e960 0x7f0ef0040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.404+0000 7f0f027fc640 1 -- 172.21.15.97:0/3444738671 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f0f0804f6f0 con 0x7f0f0c09ca50 2024-09-11T14:11:02.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.404+0000 7f0f1152c640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0ef003e960 0x7f0ef0040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.405+0000 7f0f1152c640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0ef003e960 0x7f0ef0040e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.409+0000 7f0f027fc640 1 -- 172.21.15.97:0/3444738671 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0f0800dc60 con 0x7f0f0c09ca50 2024-09-11T14:11:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.585+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f0c09ce60 con 0x7f0f0c09ca50 2024-09-11T14:11:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.586+0000 7f0f027fc640 1 -- 172.21.15.97:0/3444738671 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8883 (crc 0 0 0) 0x7f0f0800d660 con 0x7f0f0c09ca50 2024-09-11T14:11:02.588 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:11:02.588 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":14,"fsid":"f3855fa8-d59d-46b3-8802-359d51f9681f","created":"2024-09-11T14:10:48.224532+0000","modified":"2024-09-11T14:11:01.569517+0000","last_up_change":"2024-09-11T14:10:55.538592+0000","last_in_change":"2024-09-11T14:10:50.338674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:10:56.553117+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:10:58.455255+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22e03614-3c25-4e5f-9dcc-6ea59cce138b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6801","nonce":2470268139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2470268139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6805","nonce":2470268139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2470268139}]},"public_addr":"172.21.15.97:6801/2470268139","cluster_addr":"172.21.15.97:6800/2470268139","heartbeat_back_addr":"172.21.15.97:6805/2470268139","heartbeat_front_addr":"172.21.15.97:6802/2470268139","state":["exists","up"]},{"osd":1,"uuid":"d2ff11a2-ef9b-4bd8-aaa9-73003208b30a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1629092190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1629092190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1629092190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1629092190}]},"public_addr":"172.21.15.97:6804/1629092190","cluster_addr":"172.21.15.97:6803/1629092190","heartbeat_back_addr":"172.21.15.97:6807/1629092190","heartbeat_front_addr":"172.21.15.97:6808/1629092190","state":["exists","up"]},{"osd":2,"uuid":"40d2d04e-30e4-45e0-bbb5-a159d1eb2779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":2173725438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2173725438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2173725438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":2173725438}]},"public_addr":"172.21.15.117:6811/2173725438","cluster_addr":"172.21.15.117:6810/2173725438","heartbeat_back_addr":"172.21.15.117:6806/2173725438","heartbeat_front_addr":"172.21.15.117:6803/2173725438","state":["exists","up"]},{"osd":3,"uuid":"b73e62e2-3d2b-4bf6-8961-2ea27b214707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":4196478755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":4196478755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":4196478755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":4196478755}]},"public_addr":"172.21.15.117:6808/4196478755","cluster_addr":"172.21.15.117:6807/4196478755","heartbeat_back_addr":"172.21.15.117:6805/4196478755","heartbeat_front_addr":"172.21.15.117:6804/4196478755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0ef003e960 msgr2=0x7f0ef0040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0ef003e960 0x7f0ef0040e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09ca50 msgr2=0x7f0f0c122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09ca50 0x7f0f0c122dc0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 shutdown_connections 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0ef003e960 0x7f0ef0040e70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 --2- 172.21.15.97:0/3444738671 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f0c09ca50 0x7f0f0c122dc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 >> 172.21.15.97:0/3444738671 conn(0x7f0f0c0a5230 msgr2=0x7f0f0c0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 shutdown_connections 2024-09-11T14:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.588+0000 7f0f13f91640 1 -- 172.21.15.97:0/3444738671 wait complete. 2024-09-11T14:11:02.600 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T14:11:02.601 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:11:02.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.704+0000 7f832d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:02.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.709+0000 7f832d391640 1 Processor -- start 2024-09-11T14:11:02.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.709+0000 7f832d391640 1 -- start start 2024-09-11T14:11:02.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.710+0000 7f832d391640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8328138fd0 0x7f832813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.710+0000 7f832d391640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8328136c10 con 0x7f83281360f0 2024-09-11T14:11:02.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.710+0000 7f832d391640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f83280a6010 con 0x7f8328138fd0 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.710+0000 7f83267fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8328138fd0 0x7f832813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.710+0000 7f83267fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8328138fd0 0x7f832813b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59266/0 (socket says 172.21.15.97:59266) 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.710+0000 7f83267fc640 1 -- 172.21.15.97:0/2444388956 learned_addr learned my addr 172.21.15.97:0/2444388956 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.710+0000 7f8326ffd640 1 --1- 172.21.15.97:0/2444388956 >> v1:172.21.15.97:6789/0 conn(0x7f83281360f0 0x7f8328136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55446/0 (socket says 172.21.15.97:55446) 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.711+0000 7f83267fc640 1 -- 172.21.15.97:0/2444388956 >> v1:172.21.15.97:6789/0 conn(0x7f83281360f0 legacy=0x7f8328136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.711+0000 7f8325ffb640 1 -- 172.21.15.97:0/2444388956 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426782627 0 0) 0x7f8318001110 con 0x7f83281360f0 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.711+0000 7f83267fc640 1 -- 172.21.15.97:0/2444388956 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83280a5c40 con 0x7f8328138fd0 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.711+0000 7f83267fc640 1 --2- 172.21.15.97:0/2444388956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8328138fd0 0x7f832813b3f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1148fdc1591dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.711+0000 7f8325ffb640 1 -- 172.21.15.97:0/2444388956 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f831c009e50 con 0x7f8328138fd0 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.711+0000 7f8325ffb640 1 -- 172.21.15.97:0/2444388956 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f831c00e230 con 0x7f8328138fd0 2024-09-11T14:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.711+0000 7f8325ffb640 1 -- 172.21.15.97:0/2444388956 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f831c00e4d0 con 0x7f8328138fd0 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 1 -- 172.21.15.97:0/2444388956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8328138fd0 msgr2=0x7f832813b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 1 --2- 172.21.15.97:0/2444388956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8328138fd0 0x7f832813b3f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 1 -- 172.21.15.97:0/2444388956 shutdown_connections 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 1 --2- 172.21.15.97:0/2444388956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8328138fd0 0x7f832813b3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 1 -- 172.21.15.97:0/2444388956 >> 172.21.15.97:0/2444388956 conn(0x7f832806f850 msgr2=0x7f832809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 1 -- 172.21.15.97:0/2444388956 shutdown_connections 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 1 -- 172.21.15.97:0/2444388956 wait complete. 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.712+0000 7f832d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.714+0000 7f832d391640 1 Processor -- start 2024-09-11T14:11:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.714+0000 7f832d391640 1 -- start start 2024-09-11T14:11:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f832d391640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83281360f0 0x7f83281231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f832d391640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8328122e30 con 0x7f83281360f0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f8326ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83281360f0 0x7f83281231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f8326ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83281360f0 0x7f83281231f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59282/0 (socket says 172.21.15.97:59282) 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f8326ffd640 1 -- 172.21.15.97:0/337477603 learned_addr learned my addr 172.21.15.97:0/337477603 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f8326ffd640 1 -- 172.21.15.97:0/337477603 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8328124f70 con 0x7f83281360f0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f8326ffd640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83281360f0 0x7f83281231f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f830f7fe640 1 -- 172.21.15.97:0/337477603 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8318004b80 con 0x7f83281360f0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f830f7fe640 1 -- 172.21.15.97:0/337477603 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8318004ce0 con 0x7f83281360f0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8328125220 con 0x7f83281360f0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f830f7fe640 1 -- 172.21.15.97:0/337477603 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8318007120 con 0x7f83281360f0 2024-09-11T14:11:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.715+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8328122780 con 0x7f83281360f0 2024-09-11T14:11:02.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.716+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83280a10f0 con 0x7f83281360f0 2024-09-11T14:11:02.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.717+0000 7f830f7fe640 1 -- 172.21.15.97:0/337477603 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f83180072d0 con 0x7f83281360f0 2024-09-11T14:11:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.717+0000 7f830f7fe640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f831403e960 0x7f8314040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.717+0000 7f830f7fe640 1 -- 172.21.15.97:0/337477603 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f831804f6f0 con 0x7f83281360f0 2024-09-11T14:11:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.717+0000 7f83267fc640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f831403e960 0x7f8314040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.718+0000 7f83267fc640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f831403e960 0x7f8314040e70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:02.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.722+0000 7f830f7fe640 1 -- 172.21.15.97:0/337477603 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f831800a890 con 0x7f83281360f0 2024-09-11T14:11:02.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.896+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8328136c10 con 0x7f83281360f0 2024-09-11T14:11:02.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.897+0000 7f830f7fe640 1 -- 172.21.15.97:0/337477603 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8883 (crc 0 0 0) 0x7f8328136c10 con 0x7f83281360f0 2024-09-11T14:11:02.898 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:11:02.899 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":14,"fsid":"f3855fa8-d59d-46b3-8802-359d51f9681f","created":"2024-09-11T14:10:48.224532+0000","modified":"2024-09-11T14:11:01.569517+0000","last_up_change":"2024-09-11T14:10:55.538592+0000","last_in_change":"2024-09-11T14:10:50.338674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:10:56.553117+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:10:58.455255+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22e03614-3c25-4e5f-9dcc-6ea59cce138b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6801","nonce":2470268139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2470268139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6805","nonce":2470268139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2470268139}]},"public_addr":"172.21.15.97:6801/2470268139","cluster_addr":"172.21.15.97:6800/2470268139","heartbeat_back_addr":"172.21.15.97:6805/2470268139","heartbeat_front_addr":"172.21.15.97:6802/2470268139","state":["exists","up"]},{"osd":1,"uuid":"d2ff11a2-ef9b-4bd8-aaa9-73003208b30a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1629092190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1629092190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1629092190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1629092190}]},"public_addr":"172.21.15.97:6804/1629092190","cluster_addr":"172.21.15.97:6803/1629092190","heartbeat_back_addr":"172.21.15.97:6807/1629092190","heartbeat_front_addr":"172.21.15.97:6808/1629092190","state":["exists","up"]},{"osd":2,"uuid":"40d2d04e-30e4-45e0-bbb5-a159d1eb2779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":2173725438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2173725438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2173725438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":2173725438}]},"public_addr":"172.21.15.117:6811/2173725438","cluster_addr":"172.21.15.117:6810/2173725438","heartbeat_back_addr":"172.21.15.117:6806/2173725438","heartbeat_front_addr":"172.21.15.117:6803/2173725438","state":["exists","up"]},{"osd":3,"uuid":"b73e62e2-3d2b-4bf6-8961-2ea27b214707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":4196478755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":4196478755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":4196478755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":4196478755}]},"public_addr":"172.21.15.117:6808/4196478755","cluster_addr":"172.21.15.117:6807/4196478755","heartbeat_back_addr":"172.21.15.117:6805/4196478755","heartbeat_front_addr":"172.21.15.117:6804/4196478755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f831403e960 msgr2=0x7f8314040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f831403e960 0x7f8314040e70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83281360f0 msgr2=0x7f83281231f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83281360f0 0x7f83281231f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 shutdown_connections 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f831403e960 0x7f8314040e70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 --2- 172.21.15.97:0/337477603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83281360f0 0x7f83281231f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 >> 172.21.15.97:0/337477603 conn(0x7f832806f850 msgr2=0x7f832809df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 shutdown_connections 2024-09-11T14:11:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:02.899+0000 7f832d391640 1 -- 172.21.15.97:0/337477603 wait complete. 2024-09-11T14:11:02.913 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T14:11:02.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T14:11:02.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T14:11:02.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T14:11:03.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.026+0000 7f3148991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.026+0000 7f5bec85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.026+0000 7f78b1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.026+0000 7f12eb4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f5bec85c640 1 Processor -- start 2024-09-11T14:11:03.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f78b1191640 1 Processor -- start 2024-09-11T14:11:03.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f5bec85c640 1 -- start start 2024-09-11T14:11:03.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f12eb4d1640 1 Processor -- start 2024-09-11T14:11:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f3148991640 1 Processor -- start 2024-09-11T14:11:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f78b1191640 1 -- start start 2024-09-11T14:11:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f3148991640 1 -- start start 2024-09-11T14:11:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.032+0000 7f12eb4d1640 1 -- start start 2024-09-11T14:11:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f78b1191640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f78ac138fd0 0x7f78ac13b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f78b1191640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ac136c10 con 0x7f78ac1360f0 2024-09-11T14:11:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f78b1191640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac0a6010 con 0x7f78ac138fd0 2024-09-11T14:11:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f12eb4d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12e409ca50 0x7f12e409ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f5bec85c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5be80a0590 0x7f5be81390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f78aad9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f78ac1360f0 0x7f78ac136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55458/0 (socket says 172.21.15.97:55458) 2024-09-11T14:11:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f78aad9d640 1 -- 172.21.15.97:0/521913262 learned_addr learned my addr 172.21.15.97:0/521913262 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f78aa59c640 1 --2- 172.21.15.97:0/521913262 >> v2:172.21.15.97:3300/0 conn(0x7f78ac138fd0 0x7f78ac13b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.033+0000 7f5bec85c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be8071b20 con 0x7f5be809fa70 2024-09-11T14:11:03.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f5bec85c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5be80a0b30 con 0x7f5be80a0590 2024-09-11T14:11:03.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f3148991640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3144138fd0 0x7f314413b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f3148991640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3144136c10 con 0x7f31441360f0 2024-09-11T14:11:03.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f12e926d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12e409ca50 0x7f12e409ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f3148991640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f31440a6010 con 0x7f3144138fd0 2024-09-11T14:11:03.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f12e926d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12e409ca50 0x7f12e409ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59314/0 (socket says 172.21.15.97:59314) 2024-09-11T14:11:03.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f5be659c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5be809fa70 0x7f5be809fe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55484/0 (socket says 172.21.15.97:55484) 2024-09-11T14:11:03.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f5be5d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5be80a0590 0x7f5be81390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f5be659c640 1 -- 172.21.15.97:0/3422812917 learned_addr learned my addr 172.21.15.97:0/3422812917 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f12e926d640 1 -- 172.21.15.97:0/312233880 learned_addr learned my addr 172.21.15.97:0/312233880 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f12eb4d1640 1 -- 172.21.15.97:0/312233880 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e40a0060 con 0x7f12e409d3a0 2024-09-11T14:11:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f12eb4d1640 1 -- 172.21.15.97:0/312233880 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f12e409fd30 con 0x7f12e409ca50 2024-09-11T14:11:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f314259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f31441360f0 0x7f3144136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55472/0 (socket says 172.21.15.97:55472) 2024-09-11T14:11:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f314259c640 1 -- 172.21.15.97:0/4251914886 learned_addr learned my addr 172.21.15.97:0/4251914886 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f3141d9b640 1 --2- 172.21.15.97:0/4251914886 >> v2:172.21.15.97:3300/0 conn(0x7f3144138fd0 0x7f314413b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f12e926d640 1 -- 172.21.15.97:0/312233880 >> v1:172.21.15.97:6789/0 conn(0x7f12e409d3a0 legacy=0x7f12e4135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f12e926d640 1 -- 172.21.15.97:0/312233880 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e409e3c0 con 0x7f12e409ca50 2024-09-11T14:11:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f78a9d9b640 1 -- 172.21.15.97:0/521913262 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083460284 0 0) 0x7f789c001110 con 0x7f78ac1360f0 2024-09-11T14:11:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f78a9d9b640 1 -- 172.21.15.97:0/521913262 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7894003580 con 0x7f78ac1360f0 2024-09-11T14:11:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f78aa59c640 1 -- 172.21.15.97:0/521913262 >> v1:172.21.15.97:6789/0 conn(0x7f78ac1360f0 legacy=0x7f78ac136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f78aa59c640 1 -- 172.21.15.97:0/521913262 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac0a5c40 con 0x7f78ac138fd0 2024-09-11T14:11:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f5be5d9b640 1 -- 172.21.15.97:0/3422812917 >> v1:172.21.15.97:6789/0 conn(0x7f5be809fa70 legacy=0x7f5be809fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f5be5d9b640 1 -- 172.21.15.97:0/3422812917 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be80a1a60 con 0x7f5be80a0590 2024-09-11T14:11:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f314159a640 1 -- 172.21.15.97:0/4251914886 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009995442 0 0) 0x7f3134001110 con 0x7f31441360f0 2024-09-11T14:11:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.034+0000 7f314159a640 1 -- 172.21.15.97:0/4251914886 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f312c003580 con 0x7f31441360f0 2024-09-11T14:11:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f3141d9b640 1 -- 172.21.15.97:0/4251914886 >> v1:172.21.15.97:6789/0 conn(0x7f31441360f0 legacy=0x7f3144136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f3141d9b640 1 -- 172.21.15.97:0/4251914886 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31440a5c40 con 0x7f3144138fd0 2024-09-11T14:11:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f12e926d640 1 --2- 172.21.15.97:0/312233880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e409ce60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a45d3ddb39ae94f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f12dbfff640 1 -- 172.21.15.97:0/312233880 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f12e0009e40 con 0x7f12e409ca50 2024-09-11T14:11:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f3141d9b640 1 --2- 172.21.15.97:0/4251914886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3144138fd0 0x7f314413b3f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c961d38145ac7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f78aa59c640 1 --2- 172.21.15.97:0/521913262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac138fd0 0x7f78ac13b3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a160dfc4b884ef06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f12dbfff640 1 -- 172.21.15.97:0/312233880 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f12e000e230 con 0x7f12e409ca50 2024-09-11T14:11:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f12dbfff640 1 -- 172.21.15.97:0/312233880 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f12e000e4d0 con 0x7f12e409ca50 2024-09-11T14:11:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f5be5d9b640 1 --2- 172.21.15.97:0/3422812917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80a0590 0x7f5be81390a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b4415e458faca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f314159a640 1 -- 172.21.15.97:0/4251914886 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3138009d90 con 0x7f3144138fd0 2024-09-11T14:11:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f314159a640 1 -- 172.21.15.97:0/4251914886 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f313800e230 con 0x7f3144138fd0 2024-09-11T14:11:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f5be559a640 1 -- 172.21.15.97:0/3422812917 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5bdc009d90 con 0x7f5be80a0590 2024-09-11T14:11:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f78a9d9b640 1 -- 172.21.15.97:0/521913262 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f78a0009d90 con 0x7f78ac138fd0 2024-09-11T14:11:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f5be559a640 1 -- 172.21.15.97:0/3422812917 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5bdc00e230 con 0x7f5be80a0590 2024-09-11T14:11:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f314159a640 1 -- 172.21.15.97:0/4251914886 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f313800e4d0 con 0x7f3144138fd0 2024-09-11T14:11:03.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f78a9d9b640 1 -- 172.21.15.97:0/521913262 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f78a000e230 con 0x7f78ac138fd0 2024-09-11T14:11:03.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.035+0000 7f78a9d9b640 1 -- 172.21.15.97:0/521913262 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f78a000e4d0 con 0x7f78ac138fd0 2024-09-11T14:11:03.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5be559a640 1 -- 172.21.15.97:0/3422812917 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5bdc00e4d0 con 0x7f5be80a0590 2024-09-11T14:11:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 1 -- 172.21.15.97:0/312233880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 msgr2=0x7f12e409ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/312233880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e409ce60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 1 -- 172.21.15.97:0/312233880 shutdown_connections 2024-09-11T14:11:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/312233880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e409ce60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 1 -- 172.21.15.97:0/312233880 >> 172.21.15.97:0/312233880 conn(0x7f12e40a5230 msgr2=0x7f12e40a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5bec85c640 1 -- 172.21.15.97:0/3422812917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80a0590 msgr2=0x7f5be81390a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3422812917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80a0590 0x7f5be81390a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 1 -- 172.21.15.97:0/312233880 shutdown_connections 2024-09-11T14:11:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 1 -- 172.21.15.97:0/312233880 wait complete. 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5bec85c640 1 -- 172.21.15.97:0/3422812917 shutdown_connections 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3422812917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be80a0590 0x7f5be81390a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5bec85c640 1 -- 172.21.15.97:0/3422812917 >> 172.21.15.97:0/3422812917 conn(0x7f5be80a33b0 msgr2=0x7f5be80a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5bec85c640 1 -- 172.21.15.97:0/3422812917 shutdown_connections 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f5bec85c640 1 -- 172.21.15.97:0/3422812917 wait complete. 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.036+0000 7f12eb4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 1 -- 172.21.15.97:0/4251914886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3144138fd0 msgr2=0x7f314413b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 1 --2- 172.21.15.97:0/4251914886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3144138fd0 0x7f314413b3f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f5bec85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 1 -- 172.21.15.97:0/521913262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac138fd0 msgr2=0x7f78ac13b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 1 --2- 172.21.15.97:0/521913262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac138fd0 0x7f78ac13b3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 1 -- 172.21.15.97:0/4251914886 shutdown_connections 2024-09-11T14:11:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 1 --2- 172.21.15.97:0/4251914886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3144138fd0 0x7f314413b3f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 1 -- 172.21.15.97:0/4251914886 >> 172.21.15.97:0/4251914886 conn(0x7f314406f850 msgr2=0x7f314409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 1 -- 172.21.15.97:0/521913262 shutdown_connections 2024-09-11T14:11:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 1 --2- 172.21.15.97:0/521913262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac138fd0 0x7f78ac13b3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 1 -- 172.21.15.97:0/521913262 >> 172.21.15.97:0/521913262 conn(0x7f78ac06f850 msgr2=0x7f78ac09ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 1 -- 172.21.15.97:0/4251914886 shutdown_connections 2024-09-11T14:11:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 1 -- 172.21.15.97:0/4251914886 wait complete. 2024-09-11T14:11:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 1 -- 172.21.15.97:0/521913262 shutdown_connections 2024-09-11T14:11:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 1 -- 172.21.15.97:0/521913262 wait complete. 2024-09-11T14:11:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f3148991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.037+0000 7f78b1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.038+0000 7f12eb4d1640 1 Processor -- start 2024-09-11T14:11:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.038+0000 7f12eb4d1640 1 -- start start 2024-09-11T14:11:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.038+0000 7f5bec85c640 1 Processor -- start 2024-09-11T14:11:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.038+0000 7f5bec85c640 1 -- start start 2024-09-11T14:11:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.039+0000 7f5bec85c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be809fa70 0x7f5be8122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.039+0000 7f12eb4d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e4123980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.039+0000 7f12eb4d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f12e4125400 con 0x7f12e409ca50 2024-09-11T14:11:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.039+0000 7f5bec85c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5be8134180 con 0x7f5be809fa70 2024-09-11T14:11:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.039+0000 7f12e926d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e4123980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f5be659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be809fa70 0x7f5be8122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f3148991640 1 Processor -- start 2024-09-11T14:11:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12e926d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e4123980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59336/0 (socket says 172.21.15.97:59336) 2024-09-11T14:11:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12e926d640 1 -- 172.21.15.97:0/2594950719 learned_addr learned my addr 172.21.15.97:0/2594950719 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f5be659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be809fa70 0x7f5be8122c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59332/0 (socket says 172.21.15.97:59332) 2024-09-11T14:11:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f5be659c640 1 -- 172.21.15.97:0/3642756233 learned_addr learned my addr 172.21.15.97:0/3642756233 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f3148991640 1 -- start start 2024-09-11T14:11:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12e926d640 1 -- 172.21.15.97:0/2594950719 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e4124bc0 con 0x7f12e409ca50 2024-09-11T14:11:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f5be659c640 1 -- 172.21.15.97:0/3642756233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be8121520 con 0x7f5be809fa70 2024-09-11T14:11:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f78b1191640 1 Processor -- start 2024-09-11T14:11:03.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12e926d640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e4123980 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f78b1191640 1 -- start start 2024-09-11T14:11:03.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12d9ffb640 1 -- 172.21.15.97:0/2594950719 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f12e0015420 con 0x7f12e409ca50 2024-09-11T14:11:03.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12d9ffb640 1 -- 172.21.15.97:0/2594950719 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f12e0015580 con 0x7f12e409ca50 2024-09-11T14:11:03.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f5be659c640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be809fa70 0x7f5be8122c60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e4136cd0 con 0x7f12e409ca50 2024-09-11T14:11:03.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f12d9ffb640 1 -- 172.21.15.97:0/2594950719 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f12e0015820 con 0x7f12e409ca50 2024-09-11T14:11:03.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.041+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e4126290 con 0x7f12e409ca50 2024-09-11T14:11:03.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.040+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5bd8005a60 con 0x7f5be809fa70 2024-09-11T14:11:03.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.041+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be8120ed0 con 0x7f5be809fa70 2024-09-11T14:11:03.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.041+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5bd8005bc0 con 0x7f5be809fa70 2024-09-11T14:11:03.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.041+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5bd8005e60 con 0x7f5be809fa70 2024-09-11T14:11:03.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.041+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be8120bc0 con 0x7f5be809fa70 2024-09-11T14:11:03.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f3148991640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31441360f0 0x7f31441ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5be8071730 con 0x7f5be809fa70 2024-09-11T14:11:03.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f12d9ffb640 1 -- 172.21.15.97:0/2594950719 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f12e0015a20 con 0x7f12e409ca50 2024-09-11T14:11:03.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f3148991640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3144125670 con 0x7f31441360f0 2024-09-11T14:11:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f12d9ffb640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f12c803e930 0x7f12c8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f12d9ffb640 1 -- 172.21.15.97:0/2594950719 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f12e0051200 con 0x7f12e409ca50 2024-09-11T14:11:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f78b1191640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac1360f0 0x7f78ac120950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f78b1191640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac124910 con 0x7f78ac1360f0 2024-09-11T14:11:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/2594950719 >> v2:172.21.15.117:6808/4196478755 conn(0x7f12e409d3a0 0x7f12e41bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 --> v2:172.21.15.117:6808/4196478755 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12e409f9b0 con 0x7f12e409d3a0 2024-09-11T14:11:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f78aad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac1360f0 0x7f78ac120950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f78aad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac1360f0 0x7f78ac120950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59354/0 (socket says 172.21.15.97:59354) 2024-09-11T14:11:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f78aad9d640 1 -- 172.21.15.97:0/1960429850 learned_addr learned my addr 172.21.15.97:0/1960429850 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f314259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31441360f0 0x7f31441ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f314259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31441360f0 0x7f31441ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59344/0 (socket says 172.21.15.97:59344) 2024-09-11T14:11:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.042+0000 7f314259c640 1 -- 172.21.15.97:0/247115263 learned_addr learned my addr 172.21.15.97:0/247115263 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f12e8a6c640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f12c803e930 0x7f12c8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f78aad9d640 1 -- 172.21.15.97:0/1960429850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac121c00 con 0x7f78ac1360f0 2024-09-11T14:11:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f314259c640 1 -- 172.21.15.97:0/247115263 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3144121a20 con 0x7f31441360f0 2024-09-11T14:11:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f78aad9d640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac1360f0 0x7f78ac120950 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f314259c640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31441360f0 0x7f31441ca950 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f789c005930 con 0x7f78ac1360f0 2024-09-11T14:11:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3134005930 con 0x7f31441360f0 2024-09-11T14:11:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac122390 con 0x7f78ac1360f0 2024-09-11T14:11:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f789c005a90 con 0x7f78ac1360f0 2024-09-11T14:11:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f12e9a6e640 1 --2- 172.21.15.97:0/2594950719 >> v2:172.21.15.117:6808/4196478755 conn(0x7f12e409d3a0 0x7f12e41bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:11:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3134005a90 con 0x7f31441360f0 2024-09-11T14:11:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5bd800c7f0 con 0x7f5be809fa70 2024-09-11T14:11:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3134005d30 con 0x7f31441360f0 2024-09-11T14:11:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31441230f0 con 0x7f31441360f0 2024-09-11T14:11:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f12e8a6c640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f12c803e930 0x7f12c8040e40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.043+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441239a0 con 0x7f31441360f0 2024-09-11T14:11:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f789c005d30 con 0x7f78ac1360f0 2024-09-11T14:11:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f5bd6ffd640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5bc803e960 0x7f5bc8040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f5bd804f9b0 con 0x7f5be809fa70 2024-09-11T14:11:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f5bd6ffd640 1 --2- 172.21.15.97:0/3642756233 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5bc8043960 0x7f5bc8045e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 --> v2:172.21.15.97:6804/1629092190 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bc80464c0 con 0x7f5bc8043960 2024-09-11T14:11:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f5bd804fcd0 con 0x7f5be809fa70 2024-09-11T14:11:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac134b00 con 0x7f78ac1360f0 2024-09-11T14:11:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f3130ff9640 1 -- 172.21.15.97:0/247115263 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f311c000f80 con 0x7f31441360f0 2024-09-11T14:11:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.044+0000 7f5be5d9b640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5bc803e960 0x7f5bc8040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f789c00c800 con 0x7f78ac1360f0 2024-09-11T14:11:03.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78ac0a1120 con 0x7f78ac1360f0 2024-09-11T14:11:03.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f313400c800 con 0x7f31441360f0 2024-09-11T14:11:03.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f5be5d9b640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5bc803e960 0x7f5bc8040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78937fe640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f789803e910 0x7f7898040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f789c04f460 con 0x7f78ac1360f0 2024-09-11T14:11:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78aa59c640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f789803e910 0x7f7898040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78937fe640 1 --2- 172.21.15.97:0/1960429850 >> v2:172.21.15.117:6811/2173725438 conn(0x7f7898043910 0x7f7898045de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f3132ffd640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f312403e960 0x7f3124040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f313404f530 con 0x7f31441360f0 2024-09-11T14:11:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.046+0000 7f3132ffd640 1 --2- 172.21.15.97:0/247115263 >> v2:172.21.15.97:6801/2470268139 conn(0x7f3124043960 0x7f3124045e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 --> v2:172.21.15.117:6811/2173725438 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7898046470 con 0x7f7898043910 2024-09-11T14:11:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.045+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f789c0507c0 con 0x7f78ac1360f0 2024-09-11T14:11:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.046+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 --> v2:172.21.15.97:6801/2470268139 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31240464c0 con 0x7f3124043960 2024-09-11T14:11:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.046+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f3134051a20 con 0x7f31441360f0 2024-09-11T14:11:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.046+0000 7f3141d9b640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f312403e960 0x7f3124040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.046+0000 7f5be6d9d640 1 --2- 172.21.15.97:0/3642756233 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5bc8043960 0x7f5bc8045e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:11:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.046+0000 7f78aa59c640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f789803e910 0x7f7898040e20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.046+0000 7f3141d9b640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f312403e960 0x7f3124040e70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.047+0000 7f3142d9d640 1 --2- 172.21.15.97:0/247115263 >> v2:172.21.15.97:6801/2470268139 conn(0x7f3124043960 0x7f3124045e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:11:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.047+0000 7f78ab59e640 1 --2- 172.21.15.97:0/1960429850 >> v2:172.21.15.117:6811/2173725438 conn(0x7f7898043910 0x7f7898045de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:11:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.047+0000 7f12e9a6e640 1 --2- 172.21.15.97:0/2594950719 >> v2:172.21.15.117:6808/4196478755 conn(0x7f12e409d3a0 0x7f12e41bd7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.049+0000 7f12d9ffb640 1 -- 172.21.15.97:0/2594950719 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f12dc00a820 con 0x7f12e409d3a0 2024-09-11T14:11:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.050+0000 7f3142d9d640 1 --2- 172.21.15.97:0/247115263 >> v2:172.21.15.97:6801/2470268139 conn(0x7f3124043960 0x7f3124045e30 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.050+0000 7f5be6d9d640 1 --2- 172.21.15.97:0/3642756233 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5bc8043960 0x7f5bc8045e30 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.052+0000 7f78ab59e640 1 --2- 172.21.15.97:0/1960429850 >> v2:172.21.15.117:6811/2173725438 conn(0x7f7898043910 0x7f7898045de0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.052+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f31240464c0 con 0x7f3124043960 2024-09-11T14:11:03.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.052+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f5bc80464c0 con 0x7f5bc8043960 2024-09-11T14:11:03.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.054+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== osd.2 v2:172.21.15.117:6811/2173725438 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f7898046470 con 0x7f7898043910 2024-09-11T14:11:03.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.054+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 --> v2:172.21.15.117:6808/4196478755 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f12e40a5fb0 con 0x7f12e409d3a0 2024-09-11T14:11:03.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f12d9ffb640 1 -- 172.21.15.97:0/2594950719 <== osd.3 v2:172.21.15.117:6808/4196478755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f12dc00ad10 con 0x7f12e409d3a0 2024-09-11T14:11:03.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 >> v2:172.21.15.117:6808/4196478755 conn(0x7f12e409d3a0 msgr2=0x7f12e41bd7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/2594950719 >> v2:172.21.15.117:6808/4196478755 conn(0x7f12e409d3a0 0x7f12e41bd7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f3130ff9640 1 -- 172.21.15.97:0/247115263 --> v2:172.21.15.97:6801/2470268139 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f311c002c30 con 0x7f3124043960 2024-09-11T14:11:03.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f12c803e930 msgr2=0x7f12c8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f12c803e930 0x7f12c8040e40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 msgr2=0x7f12e4123980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.055+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e4123980 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.056+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 shutdown_connections 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.056+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/2594950719 >> v2:172.21.15.117:6808/4196478755 conn(0x7f12e409d3a0 0x7f12e41bd7c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.056+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f12c803e930 0x7f12c8040e40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.056+0000 7f12eb4d1640 1 --2- 172.21.15.97:0/2594950719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12e409ca50 0x7f12e4123980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.056+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 >> 172.21.15.97:0/2594950719 conn(0x7f12e40a5230 msgr2=0x7f12e41bc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.056+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 shutdown_connections 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.056+0000 7f12eb4d1640 1 -- 172.21.15.97:0/2594950719 wait complete. 2024-09-11T14:11:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.057+0000 7f3132ffd640 1 -- 172.21.15.97:0/247115263 <== osd.0 v2:172.21.15.97:6801/2470268139 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f311c002c30 con 0x7f3124043960 2024-09-11T14:11:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.057+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 --> v2:172.21.15.97:6804/1629092190 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5be80a4130 con 0x7f5bc8043960 2024-09-11T14:11:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 >> v2:172.21.15.97:6801/2470268139 conn(0x7f3124043960 msgr2=0x7f3124045e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 --2- 172.21.15.97:0/247115263 >> v2:172.21.15.97:6801/2470268139 conn(0x7f3124043960 0x7f3124045e30 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f312403e960 msgr2=0x7f3124040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f312403e960 0x7f3124040e70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31441360f0 msgr2=0x7f31441ca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31441360f0 0x7f31441ca950 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 shutdown_connections 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.058+0000 7f3148991640 1 --2- 172.21.15.97:0/247115263 >> v2:172.21.15.97:6801/2470268139 conn(0x7f3124043960 0x7f3124045e30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.059+0000 7f3148991640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f312403e960 0x7f3124040e70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.059+0000 7f3148991640 1 --2- 172.21.15.97:0/247115263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31441360f0 0x7f31441ca950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.059+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 >> 172.21.15.97:0/247115263 conn(0x7f314406f850 msgr2=0x7f31441be300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.059+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 shutdown_connections 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.059+0000 7f3148991640 1 -- 172.21.15.97:0/247115263 wait complete. 2024-09-11T14:11:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.060+0000 7f5bd6ffd640 1 -- 172.21.15.97:0/3642756233 <== osd.1 v2:172.21.15.97:6804/1629092190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5be000a820 con 0x7f5bc8043960 2024-09-11T14:11:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.060+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5bc8043960 msgr2=0x7f5bc8045e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.060+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3642756233 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5bc8043960 0x7f5bc8045e30 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 --> v2:172.21.15.117:6811/2173725438 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f78ac09f5d0 con 0x7f7898043910 2024-09-11T14:11:03.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5bc803e960 msgr2=0x7f5bc8040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5bc803e960 0x7f5bc8040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be809fa70 msgr2=0x7f5be8122c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be809fa70 0x7f5be8122c60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 shutdown_connections 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3642756233 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5bc8043960 0x7f5bc8045e30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5bc803e960 0x7f5bc8040e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 --2- 172.21.15.97:0/3642756233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5be809fa70 0x7f5be8122c60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 >> 172.21.15.97:0/3642756233 conn(0x7f5be80a33b0 msgr2=0x7f5be81bbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 shutdown_connections 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.061+0000 7f5bec85c640 1 -- 172.21.15.97:0/3642756233 wait complete. 2024-09-11T14:11:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.062+0000 7f78937fe640 1 -- 172.21.15.97:0/1960429850 <== osd.2 v2:172.21.15.117:6811/2173725438 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f78a400a820 con 0x7f7898043910 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 >> v2:172.21.15.117:6811/2173725438 conn(0x7f7898043910 msgr2=0x7f7898045de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 --2- 172.21.15.97:0/1960429850 >> v2:172.21.15.117:6811/2173725438 conn(0x7f7898043910 0x7f7898045de0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f789803e910 msgr2=0x7f7898040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f789803e910 0x7f7898040e20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac1360f0 msgr2=0x7f78ac120950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac1360f0 0x7f78ac120950 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 shutdown_connections 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 --2- 172.21.15.97:0/1960429850 >> v2:172.21.15.117:6811/2173725438 conn(0x7f7898043910 0x7f7898045de0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f789803e910 0x7f7898040e20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 --2- 172.21.15.97:0/1960429850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78ac1360f0 0x7f78ac120950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 >> 172.21.15.97:0/1960429850 conn(0x7f78ac06f850 msgr2=0x7f78ac1be0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 shutdown_connections 2024-09-11T14:11:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.064+0000 7f78b1191640 1 -- 172.21.15.97:0/1960429850 wait complete. 2024-09-11T14:11:03.089 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.090 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:11:03.090 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.091 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:11:03.091 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.092 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:11:03.093 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:11:03.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.242+0000 7f23cdf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.243+0000 7fc2cad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.243+0000 7faf004fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.243+0000 7fb5bcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7f23cdf91640 1 Processor -- start 2024-09-11T14:11:03.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7f23cdf91640 1 -- start start 2024-09-11T14:11:03.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7fc2cad51640 1 Processor -- start 2024-09-11T14:11:03.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7fc2cad51640 1 -- start start 2024-09-11T14:11:03.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7faf004fd640 1 Processor -- start 2024-09-11T14:11:03.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7faf004fd640 1 -- start start 2024-09-11T14:11:03.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7fb5bcf91640 1 Processor -- start 2024-09-11T14:11:03.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.249+0000 7fb5bcf91640 1 -- start start 2024-09-11T14:11:03.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7f23cdf91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23c8138fd0 0x7f23c813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7fc2cad51640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc2c409db00 0x7fc2c409df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7f23cdf91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c8136c10 con 0x7f23c81360f0 2024-09-11T14:11:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7f23cdf91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80a6010 con 0x7f23c8138fd0 2024-09-11T14:11:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7f23c77fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f23c81360f0 0x7f23c8136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55502/0 (socket says 172.21.15.97:55502) 2024-09-11T14:11:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7f23c6ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23c8138fd0 0x7f23c813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7f23c77fe640 1 -- 172.21.15.97:0/2448617389 learned_addr learned my addr 172.21.15.97:0/2448617389 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7faf004fd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faef806f3f0 0x7faef813b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7fc2c3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc2c409e450 0x7fc2c4138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55510/0 (socket says 172.21.15.97:55510) 2024-09-11T14:11:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7fc2c3fff640 1 -- 172.21.15.97:0/3598407437 learned_addr learned my addr 172.21.15.97:0/3598407437 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7faf004fd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef8070930 con 0x7faef806e8d0 2024-09-11T14:11:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7faf004fd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7faef809dbd0 con 0x7faef806f3f0 2024-09-11T14:11:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7fb5bcf91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5b809db00 0x7fb5b809df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7fc2cad51640 1 -- 172.21.15.97:0/3598407437 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c409ed40 con 0x7fc2c409e450 2024-09-11T14:11:03.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7fc2cad51640 1 -- 172.21.15.97:0/3598407437 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c40a0700 con 0x7fc2c409db00 2024-09-11T14:11:03.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7fc2c8aed640 1 --2- 172.21.15.97:0/3598407437 >> v2:172.21.15.97:3300/0 conn(0x7fc2c409db00 0x7fc2c409df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7faefda98640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faef806f3f0 0x7faef813b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7faefda98640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faef806f3f0 0x7faef813b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59376/0 (socket says 172.21.15.97:59376) 2024-09-11T14:11:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.250+0000 7faefda98640 1 -- 172.21.15.97:0/700189283 learned_addr learned my addr 172.21.15.97:0/700189283 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7f23c6ffd640 1 -- 172.21.15.97:0/2448617389 >> v1:172.21.15.97:6789/0 conn(0x7f23c81360f0 legacy=0x7f23c8136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7f23c6ffd640 1 -- 172.21.15.97:0/2448617389 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80a5c40 con 0x7f23c8138fd0 2024-09-11T14:11:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5bcf91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b809ed40 con 0x7fb5b809e450 2024-09-11T14:11:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5bcf91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb5b80a0700 con 0x7fb5b809db00 2024-09-11T14:11:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5b659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5b809db00 0x7fb5b809df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fc2c37fe640 1 -- 172.21.15.97:0/3598407437 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70350514 0 0) 0x7fc2c409ed40 con 0x7fc2c409e450 2024-09-11T14:11:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fc2c37fe640 1 -- 172.21.15.97:0/3598407437 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2b4003580 con 0x7fc2c409e450 2024-09-11T14:11:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5b659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5b809db00 0x7fb5b809df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59382/0 (socket says 172.21.15.97:59382) 2024-09-11T14:11:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5b659c640 1 -- 172.21.15.97:0/3355137708 learned_addr learned my addr 172.21.15.97:0/3355137708 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fc2c8aed640 1 -- 172.21.15.97:0/3598407437 >> v1:172.21.15.97:6789/0 conn(0x7fc2c409e450 legacy=0x7fc2c4138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7faefda98640 1 -- 172.21.15.97:0/700189283 >> v1:172.21.15.97:6789/0 conn(0x7faef806e8d0 legacy=0x7faef806ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7faefda98640 1 -- 172.21.15.97:0/700189283 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef809e5a0 con 0x7faef806f3f0 2024-09-11T14:11:03.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fc2c8aed640 1 -- 172.21.15.97:0/3598407437 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c409fbd0 con 0x7fc2c409db00 2024-09-11T14:11:03.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7faefda98640 1 --2- 172.21.15.97:0/700189283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806f3f0 0x7faef813b4b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19deb492f0c7c7ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7f23c6ffd640 1 --2- 172.21.15.97:0/2448617389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c8138fd0 0x7f23c813b3f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43ed9a0438acff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5b659c640 1 -- 172.21.15.97:0/3355137708 >> v1:172.21.15.97:6789/0 conn(0x7fb5b809e450 legacy=0x7fb5b8138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5b659c640 1 -- 172.21.15.97:0/3355137708 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b809fbd0 con 0x7fb5b809db00 2024-09-11T14:11:03.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fc2c8aed640 1 --2- 172.21.15.97:0/3598407437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c409df10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fd89c236c9177b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7faefd297640 1 -- 172.21.15.97:0/700189283 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faee8009e50 con 0x7faef806f3f0 2024-09-11T14:11:03.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7f23c67fc640 1 -- 172.21.15.97:0/2448617389 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23bc009d90 con 0x7f23c8138fd0 2024-09-11T14:11:03.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fb5b659c640 1 --2- 172.21.15.97:0/3355137708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b809df10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ed2e293d30abdf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7f23c67fc640 1 -- 172.21.15.97:0/2448617389 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f23bc00e230 con 0x7f23c8138fd0 2024-09-11T14:11:03.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7f23c67fc640 1 -- 172.21.15.97:0/2448617389 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23bc00e4d0 con 0x7f23c8138fd0 2024-09-11T14:11:03.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7fc2c37fe640 1 -- 172.21.15.97:0/3598407437 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2b8009d80 con 0x7fc2c409db00 2024-09-11T14:11:03.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7faefd297640 1 -- 172.21.15.97:0/700189283 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faee800e230 con 0x7faef806f3f0 2024-09-11T14:11:03.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.251+0000 7faefd297640 1 -- 172.21.15.97:0/700189283 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faee800e4d0 con 0x7faef806f3f0 2024-09-11T14:11:03.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.252+0000 7fc2c37fe640 1 -- 172.21.15.97:0/3598407437 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc2b800e230 con 0x7fc2c409db00 2024-09-11T14:11:03.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.252+0000 7fc2c37fe640 1 -- 172.21.15.97:0/3598407437 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2b800e4d0 con 0x7fc2c409db00 2024-09-11T14:11:03.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.252+0000 7fb5b559a640 1 -- 172.21.15.97:0/3355137708 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5a8009e40 con 0x7fb5b809db00 2024-09-11T14:11:03.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.252+0000 7fb5b559a640 1 -- 172.21.15.97:0/3355137708 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb5a800e230 con 0x7fb5b809db00 2024-09-11T14:11:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.252+0000 7fb5b559a640 1 -- 172.21.15.97:0/3355137708 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5a800e4d0 con 0x7fb5b809db00 2024-09-11T14:11:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.252+0000 7fc2cad51640 1 -- 172.21.15.97:0/3598407437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 msgr2=0x7fc2c409df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.252+0000 7fc2cad51640 1 --2- 172.21.15.97:0/3598407437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c409df10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 1 -- 172.21.15.97:0/3355137708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 msgr2=0x7fb5b809df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 1 --2- 172.21.15.97:0/3355137708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b809df10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fc2cad51640 1 -- 172.21.15.97:0/3598407437 shutdown_connections 2024-09-11T14:11:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fc2cad51640 1 --2- 172.21.15.97:0/3598407437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c409df10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fc2cad51640 1 -- 172.21.15.97:0/3598407437 >> 172.21.15.97:0/3598407437 conn(0x7fc2c40a45b0 msgr2=0x7fc2c40a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fc2cad51640 1 -- 172.21.15.97:0/3598407437 shutdown_connections 2024-09-11T14:11:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fc2cad51640 1 -- 172.21.15.97:0/3598407437 wait complete. 2024-09-11T14:11:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 1 -- 172.21.15.97:0/3355137708 shutdown_connections 2024-09-11T14:11:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 1 --2- 172.21.15.97:0/3355137708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b809df10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 1 -- 172.21.15.97:0/3355137708 >> 172.21.15.97:0/3355137708 conn(0x7fb5b80a45b0 msgr2=0x7fb5b80a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 1 -- 172.21.15.97:0/2448617389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c8138fd0 msgr2=0x7f23c813b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 1 --2- 172.21.15.97:0/2448617389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c8138fd0 0x7f23c813b3f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 1 -- 172.21.15.97:0/700189283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806f3f0 msgr2=0x7faef813b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 1 --2- 172.21.15.97:0/700189283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806f3f0 0x7faef813b4b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 1 -- 172.21.15.97:0/3355137708 shutdown_connections 2024-09-11T14:11:03.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 1 -- 172.21.15.97:0/2448617389 shutdown_connections 2024-09-11T14:11:03.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 1 --2- 172.21.15.97:0/2448617389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c8138fd0 0x7f23c813b3f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 1 -- 172.21.15.97:0/2448617389 >> 172.21.15.97:0/2448617389 conn(0x7f23c806f850 msgr2=0x7f23c809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 1 -- 172.21.15.97:0/3355137708 wait complete. 2024-09-11T14:11:03.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 1 -- 172.21.15.97:0/700189283 shutdown_connections 2024-09-11T14:11:03.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 1 --2- 172.21.15.97:0/700189283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806f3f0 0x7faef813b4b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 1 -- 172.21.15.97:0/700189283 >> 172.21.15.97:0/700189283 conn(0x7faef80a45b0 msgr2=0x7faef80a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 1 -- 172.21.15.97:0/2448617389 shutdown_connections 2024-09-11T14:11:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 1 -- 172.21.15.97:0/700189283 shutdown_connections 2024-09-11T14:11:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 1 -- 172.21.15.97:0/700189283 wait complete. 2024-09-11T14:11:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 1 -- 172.21.15.97:0/2448617389 wait complete. 2024-09-11T14:11:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fc2cad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7fb5bcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7faf004fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.253+0000 7f23cdf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.255+0000 7faf004fd640 1 Processor -- start 2024-09-11T14:11:03.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.255+0000 7faf004fd640 1 -- start start 2024-09-11T14:11:03.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.255+0000 7f23cdf91640 1 Processor -- start 2024-09-11T14:11:03.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.255+0000 7f23cdf91640 1 -- start start 2024-09-11T14:11:03.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.255+0000 7fc2cad51640 1 Processor -- start 2024-09-11T14:11:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7faf004fd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806e8d0 0x7faef8073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7faf004fd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faef8092c70 con 0x7faef806e8d0 2024-09-11T14:11:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7faefe299640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806e8d0 0x7faef8073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7faefe299640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806e8d0 0x7faef8073360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59390/0 (socket says 172.21.15.97:59390) 2024-09-11T14:11:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7faefe299640 1 -- 172.21.15.97:0/374977286 learned_addr learned my addr 172.21.15.97:0/374977286 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7fb5bcf91640 1 Processor -- start 2024-09-11T14:11:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7fb5bcf91640 1 -- start start 2024-09-11T14:11:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7fc2cad51640 1 -- start start 2024-09-11T14:11:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7faefe299640 1 -- 172.21.15.97:0/374977286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef806d2f0 con 0x7faef806e8d0 2024-09-11T14:11:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.256+0000 7faefe299640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806e8d0 0x7faef8073360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7faeeeffd640 1 -- 172.21.15.97:0/374977286 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faef400c850 con 0x7faef806e8d0 2024-09-11T14:11:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23cdf91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c81360f0 0x7f23c8122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23cdf91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8124f10 con 0x7f23c81360f0 2024-09-11T14:11:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7faeeeffd640 1 -- 172.21.15.97:0/374977286 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faef400c9b0 con 0x7faef806e8d0 2024-09-11T14:11:03.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23c77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c81360f0 0x7f23c8122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef8099fd0 con 0x7faef806e8d0 2024-09-11T14:11:03.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7faeeeffd640 1 -- 172.21.15.97:0/374977286 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faef400cc50 con 0x7faef806e8d0 2024-09-11T14:11:03.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23c77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c81360f0 0x7f23c8122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59402/0 (socket says 172.21.15.97:59402) 2024-09-11T14:11:03.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef80992b0 con 0x7faef806e8d0 2024-09-11T14:11:03.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23c77fe640 1 -- 172.21.15.97:0/3894732572 learned_addr learned my addr 172.21.15.97:0/3894732572 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23c77fe640 1 -- 172.21.15.97:0/3894732572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c81229c0 con 0x7f23c81360f0 2024-09-11T14:11:03.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23c77fe640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c81360f0 0x7f23c8122cd0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.257+0000 7f23affff640 1 -- 172.21.15.97:0/3894732572 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23b8005a60 con 0x7f23c81360f0 2024-09-11T14:11:03.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7f23affff640 1 -- 172.21.15.97:0/3894732572 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f23b8005bc0 con 0x7f23c81360f0 2024-09-11T14:11:03.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7f23affff640 1 -- 172.21.15.97:0/3894732572 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23b8005e60 con 0x7f23c81360f0 2024-09-11T14:11:03.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fb5bcf91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b81b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fc2cad51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c406e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fb5bcf91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b81b6050 con 0x7fb5b809db00 2024-09-11T14:11:03.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fc2cad51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4074660 con 0x7fc2c409db00 2024-09-11T14:11:03.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c8126570 con 0x7f23c81360f0 2024-09-11T14:11:03.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fc2c8aed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fc2c8aed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c406e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59408/0 (socket says 172.21.15.97:59408) 2024-09-11T14:11:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fc2c8aed640 1 -- 172.21.15.97:0/2817880981 learned_addr learned my addr 172.21.15.97:0/2817880981 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fb5b659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b81b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fb5b659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b81b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59416/0 (socket says 172.21.15.97:59416) 2024-09-11T14:11:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fb5b659c640 1 -- 172.21.15.97:0/753411710 learned_addr learned my addr 172.21.15.97:0/753411710 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef813b9b0 con 0x7faef806e8d0 2024-09-11T14:11:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c8125a20 con 0x7f23c81360f0 2024-09-11T14:11:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.258+0000 7fc2c8aed640 1 -- 172.21.15.97:0/2817880981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c40986a0 con 0x7fc2c409db00 2024-09-11T14:11:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7fc2c8aed640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c406e900 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7fb5b659c640 1 -- 172.21.15.97:0/753411710 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b81b9f70 con 0x7fb5b809db00 2024-09-11T14:11:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7faeeeffd640 1 -- 172.21.15.97:0/374977286 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7faef4011310 con 0x7faef806e8d0 2024-09-11T14:11:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7fb5b659c640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b81b5830 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7fc2c17fa640 1 -- 172.21.15.97:0/2817880981 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2b8014410 con 0x7fc2c409db00 2024-09-11T14:11:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7fc2c17fa640 1 -- 172.21.15.97:0/2817880981 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc2b8014570 con 0x7fc2c409db00 2024-09-11T14:11:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7faeeeffd640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7faedc03e980 0x7faedc040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7faeeeffd640 1 -- 172.21.15.97:0/374977286 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7faef404fe50 con 0x7faef806e8d0 2024-09-11T14:11:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c80a10f0 con 0x7f23c81360f0 2024-09-11T14:11:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7fc2c17fa640 1 -- 172.21.15.97:0/2817880981 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2b8014810 con 0x7fc2c409db00 2024-09-11T14:11:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.259+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c40999e0 con 0x7fc2c409db00 2024-09-11T14:11:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.260+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c4099790 con 0x7fc2c409db00 2024-09-11T14:11:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.260+0000 7faefda98640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7faedc03e980 0x7faedc040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.260+0000 7f23affff640 1 -- 172.21.15.97:0/3894732572 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f23b800c7f0 con 0x7f23c81360f0 2024-09-11T14:11:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.260+0000 7f23affff640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f23b403e930 0x7f23b4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.260+0000 7f23affff640 1 -- 172.21.15.97:0/3894732572 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f23b804f6e0 con 0x7f23c81360f0 2024-09-11T14:11:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.260+0000 7f23c6ffd640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f23b403e930 0x7f23b4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.260+0000 7faefda98640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7faedc03e980 0x7faedc040e90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.261+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c40977a0 con 0x7fc2c409db00 2024-09-11T14:11:03.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.261+0000 7f23c6ffd640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f23b403e930 0x7f23b4040e40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.265+0000 7fb5a6ffd640 1 -- 172.21.15.97:0/753411710 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5a800ed90 con 0x7fb5b809db00 2024-09-11T14:11:03.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.265+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b81b43f0 con 0x7fb5b809db00 2024-09-11T14:11:03.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.265+0000 7faeeeffd640 1 -- 172.21.15.97:0/374977286 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7faef400d150 con 0x7faef806e8d0 2024-09-11T14:11:03.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.265+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b81b3b20 con 0x7fb5b809db00 2024-09-11T14:11:03.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.266+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b809df10 con 0x7fb5b809db00 2024-09-11T14:11:03.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.270+0000 7f23affff640 1 -- 172.21.15.97:0/3894732572 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f23b800dc10 con 0x7f23c81360f0 2024-09-11T14:11:03.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.270+0000 7fb5a6ffd640 1 -- 172.21.15.97:0/753411710 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb5a8015420 con 0x7fb5b809db00 2024-09-11T14:11:03.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.270+0000 7fb5a6ffd640 1 -- 172.21.15.97:0/753411710 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5a80156c0 con 0x7fb5b809db00 2024-09-11T14:11:03.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.271+0000 7fc2c17fa640 1 -- 172.21.15.97:0/2817880981 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc2b8014970 con 0x7fc2c409db00 2024-09-11T14:11:03.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.271+0000 7fc2c17fa640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc2a803e980 0x7fc2a8040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.271+0000 7fc2c17fa640 1 -- 172.21.15.97:0/2817880981 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7fc2b8019040 con 0x7fc2c409db00 2024-09-11T14:11:03.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.271+0000 7fb5a6ffd640 1 -- 172.21.15.97:0/753411710 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb5a8015820 con 0x7fb5b809db00 2024-09-11T14:11:03.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.272+0000 7fb5a6ffd640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb59803e910 0x7fb598040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.272+0000 7fc2c3fff640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc2a803e980 0x7fc2a8040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.272+0000 7fb5b5d9b640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb59803e910 0x7fb598040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.272+0000 7fc2c3fff640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc2a803e980 0x7fc2a8040e90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.272+0000 7fb5b5d9b640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb59803e910 0x7fb598040e20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.276+0000 7fb5a6ffd640 1 -- 172.21.15.97:0/753411710 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7fb5a8010da0 con 0x7fb5b809db00 2024-09-11T14:11:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.276+0000 7fc2c17fa640 1 -- 172.21.15.97:0/2817880981 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc2b8019200 con 0x7fc2c409db00 2024-09-11T14:11:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.286+0000 7fb5a6ffd640 1 -- 172.21.15.97:0/753411710 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb5a8011c70 con 0x7fb5b809db00 2024-09-11T14:11:03.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.466+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc2c409df10 con 0x7fc2c409db00 2024-09-11T14:11:03.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.466+0000 7fc2c17fa640 1 -- 172.21.15.97:0/2817880981 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fc2b800f950 con 0x7fc2c409db00 2024-09-11T14:11:03.468 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc2a803e980 msgr2=0x7fc2a8040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc2a803e980 0x7fc2a8040e90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 msgr2=0x7fc2c406e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c406e900 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 shutdown_connections 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc2a803e980 0x7fc2a8040e90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 --2- 172.21.15.97:0/2817880981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2c409db00 0x7fc2c406e900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.468+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 >> 172.21.15.97:0/2817880981 conn(0x7fc2c40a45b0 msgr2=0x7fc2c40a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.469+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 shutdown_connections 2024-09-11T14:11:03.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.469+0000 7fc2cad51640 1 -- 172.21.15.97:0/2817880981 wait complete. 2024-09-11T14:11:03.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.470+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb5b8078480 con 0x7fb5b809db00 2024-09-11T14:11:03.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.470+0000 7fb5a6ffd640 1 -- 172.21.15.97:0/753411710 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fb5a8014df0 con 0x7fb5b809db00 2024-09-11T14:11:03.472 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb59803e910 msgr2=0x7fb598040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb59803e910 0x7fb598040e20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 msgr2=0x7fb5b81b5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b81b5830 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 shutdown_connections 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb59803e910 0x7fb598040e20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 --2- 172.21.15.97:0/753411710 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5b809db00 0x7fb5b81b5830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 >> 172.21.15.97:0/753411710 conn(0x7fb5b80a45b0 msgr2=0x7fb5b80a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 shutdown_connections 2024-09-11T14:11:03.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.473+0000 7fb5bcf91640 1 -- 172.21.15.97:0/753411710 wait complete. 2024-09-11T14:11:03.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-11T14:11:03.483 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:03.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-09-11T14:11:03.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.485+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faef806ece0 con 0x7faef806e8d0 2024-09-11T14:11:03.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.485+0000 7faeeeffd640 1 -- 172.21.15.97:0/374977286 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7faef400a9b0 con 0x7faef806e8d0 2024-09-11T14:11:03.487 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:03.487 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7faedc03e980 msgr2=0x7faedc040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7faedc03e980 0x7faedc040e90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806e8d0 msgr2=0x7faef8073360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806e8d0 0x7faef8073360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 shutdown_connections 2024-09-11T14:11:03.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7faedc03e980 0x7faedc040e90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 --2- 172.21.15.97:0/374977286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef806e8d0 0x7faef8073360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.487+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 >> 172.21.15.97:0/374977286 conn(0x7faef80a45b0 msgr2=0x7faef813a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.488+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 shutdown_connections 2024-09-11T14:11:03.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.488+0000 7faf004fd640 1 -- 172.21.15.97:0/374977286 wait complete. 2024-09-11T14:11:03.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.488+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f23c8136c10 con 0x7f23c81360f0 2024-09-11T14:11:03.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.489+0000 7f23affff640 1 -- 172.21.15.97:0/3894732572 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f23c8136c10 con 0x7f23c81360f0 2024-09-11T14:11:03.491 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f23b403e930 msgr2=0x7f23b4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f23b403e930 0x7f23b4040e40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c81360f0 msgr2=0x7f23c8122cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c81360f0 0x7f23c8122cd0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 shutdown_connections 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f23b403e930 0x7f23b4040e40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 --2- 172.21.15.97:0/3894732572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23c81360f0 0x7f23c8122cd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 >> 172.21.15.97:0/3894732572 conn(0x7f23c806f850 msgr2=0x7f23c80a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 shutdown_connections 2024-09-11T14:11:03.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.491+0000 7f23cdf91640 1 -- 172.21.15.97:0/3894732572 wait complete. 2024-09-11T14:11:03.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-11T14:11:03.501 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:03.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-11T14:11:03.504 DEBUG:teuthology.parallel:result is None 2024-09-11T14:11:03.504 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:11:03.504 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:11:03.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.648+0000 7f4246591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.653+0000 7f4246591640 1 Processor -- start 2024-09-11T14:11:03.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.653+0000 7f4246591640 1 -- start start 2024-09-11T14:11:03.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.654+0000 7f4246591640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42400a26d0 0x7f4240131000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.654+0000 7f4246591640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4240130bb0 con 0x7f42400a2150 2024-09-11T14:11:03.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.654+0000 7f4246591640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f424009fb00 con 0x7f42400a26d0 2024-09-11T14:11:03.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.654+0000 7f423ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42400a26d0 0x7f4240131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.654+0000 7f423ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42400a26d0 0x7f4240131000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59430/0 (socket says 172.21.15.97:59430) 2024-09-11T14:11:03.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.654+0000 7f423ffff640 1 -- 172.21.15.97:0/2144347342 learned_addr learned my addr 172.21.15.97:0/2144347342 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.655+0000 7f423ffff640 1 -- 172.21.15.97:0/2144347342 >> v1:172.21.15.97:6789/0 conn(0x7f42400a2150 legacy=0x7f4240133fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.655+0000 7f423ffff640 1 -- 172.21.15.97:0/2144347342 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424009fc40 con 0x7f42400a26d0 2024-09-11T14:11:03.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.655+0000 7f423ffff640 1 --2- 172.21.15.97:0/2144347342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a26d0 0x7f4240131000 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e7d490f6cd10d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.655+0000 7f423effd640 1 -- 172.21.15.97:0/2144347342 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4230009e50 con 0x7f42400a26d0 2024-09-11T14:11:03.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.655+0000 7f423effd640 1 -- 172.21.15.97:0/2144347342 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f423000e230 con 0x7f42400a26d0 2024-09-11T14:11:03.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.655+0000 7f423effd640 1 -- 172.21.15.97:0/2144347342 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f423000e4d0 con 0x7f42400a26d0 2024-09-11T14:11:03.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 1 -- 172.21.15.97:0/2144347342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a26d0 msgr2=0x7f4240131000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 1 --2- 172.21.15.97:0/2144347342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a26d0 0x7f4240131000 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 1 -- 172.21.15.97:0/2144347342 shutdown_connections 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 1 --2- 172.21.15.97:0/2144347342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a26d0 0x7f4240131000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 1 -- 172.21.15.97:0/2144347342 >> 172.21.15.97:0/2144347342 conn(0x7f42400a3310 msgr2=0x7f42400a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 1 -- 172.21.15.97:0/2144347342 shutdown_connections 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 1 -- 172.21.15.97:0/2144347342 wait complete. 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.656+0000 7f4246591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.657+0000 7f4246591640 1 Processor -- start 2024-09-11T14:11:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.658+0000 7f4246591640 1 -- start start 2024-09-11T14:11:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.658+0000 7f4246591640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a2150 0x7f42401ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f4246591640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f424009f170 con 0x7f42400a2150 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a2150 0x7f42401ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a2150 0x7f42401ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59436/0 (socket says 172.21.15.97:59436) 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423ffff640 1 -- 172.21.15.97:0/3693880977 learned_addr learned my addr 172.21.15.97:0/3693880977 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423ffff640 1 -- 172.21.15.97:0/3693880977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4240133c10 con 0x7f42400a2150 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423ffff640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a2150 0x7f42401ca8e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423cff9640 1 -- 172.21.15.97:0/3693880977 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f423000ee00 con 0x7f42400a2150 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423cff9640 1 -- 172.21.15.97:0/3693880977 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4230015420 con 0x7f42400a2150 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42401224f0 con 0x7f42400a2150 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f423cff9640 1 -- 172.21.15.97:0/3693880977 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f42300156c0 con 0x7f42400a2150 2024-09-11T14:11:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.659+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4240121970 con 0x7f42400a2150 2024-09-11T14:11:03.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.660+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4240120f60 con 0x7f42400a2150 2024-09-11T14:11:03.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.660+0000 7f423cff9640 1 -- 172.21.15.97:0/3693880977 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4230015870 con 0x7f42400a2150 2024-09-11T14:11:03.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.660+0000 7f423cff9640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f422c03e930 0x7f422c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.660+0000 7f423cff9640 1 -- 172.21.15.97:0/3693880977 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7f4230050d40 con 0x7f42400a2150 2024-09-11T14:11:03.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.661+0000 7f423f7fe640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f422c03e930 0x7f422c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.661+0000 7f423f7fe640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f422c03e930 0x7f422c040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.666+0000 7f423cff9640 1 -- 172.21.15.97:0/3693880977 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f4230012c00 con 0x7f42400a2150 2024-09-11T14:11:03.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.837+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42401346b0 con 0x7f422c03e930 2024-09-11T14:11:03.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.839+0000 7f423cff9640 1 -- 172.21.15.97:0/3693880977 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31130 (crc 0 0 0) 0x7f42340012b0 con 0x7f422c03e930 2024-09-11T14:11:03.841 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:11:03.841 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f422c03e930 msgr2=0x7f422c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f422c03e930 0x7f422c040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a2150 msgr2=0x7f42401ca8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a2150 0x7f42401ca8e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 shutdown_connections 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f422c03e930 0x7f422c040e40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 --2- 172.21.15.97:0/3693880977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42400a2150 0x7f42401ca8e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 >> 172.21.15.97:0/3693880977 conn(0x7f42400a3310 msgr2=0x7f42400a40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 shutdown_connections 2024-09-11T14:11:03.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.841+0000 7f4246591640 1 -- 172.21.15.97:0/3693880977 wait complete. 2024-09-11T14:11:03.853 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-11T14:11:03.064471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107952,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379408,"statfs":{"total":386547056640,"available":386436513792,"internally_reserved":0,"allocated":606208,"data_stored":1305710,"data_compressed":60090,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.588019+0000","last_change":"2024-09-11T14:11:01.590400+0000","last_active":"2024-09-11T14:11:01.588019+0000","last_peered":"2024-09-11T14:11:01.588019+0000","last_clean":"2024-09-11T14:11:01.588019+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:11:01.588019+0000","last_undegraded":"2024-09-11T14:11:01.588019+0000","last_fullsized":"2024-09-11T14:11:01.588019+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.585559+0000","last_change":"2024-09-11T14:11:01.587732+0000","last_active":"2024-09-11T14:11:01.585559+0000","last_peered":"2024-09-11T14:11:01.585559+0000","last_clean":"2024-09-11T14:11:01.585559+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:11:01.585559+0000","last_undegraded":"2024-09-11T14:11:01.585559+0000","last_fullsized":"2024-09-11T14:11:01.585559+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.585140+0000","last_change":"2024-09-11T14:11:01.587844+0000","last_active":"2024-09-11T14:11:01.585140+0000","last_peered":"2024-09-11T14:11:01.585140+0000","last_clean":"2024-09-11T14:11:01.585140+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:11:01.585140+0000","last_undegraded":"2024-09-11T14:11:01.585140+0000","last_fullsized":"2024-09-11T14:11:01.585140+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.580110+0000","last_change":"2024-09-11T14:11:01.585502+0000","last_active":"2024-09-11T14:11:01.580110+0000","last_peered":"2024-09-11T14:11:01.580110+0000","last_clean":"2024-09-11T14:11:01.580110+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:11:01.580110+0000","last_undegraded":"2024-09-11T14:11:01.580110+0000","last_fullsized":"2024-09-11T14:11:01.580110+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.588321+0000","last_change":"2024-09-11T14:11:01.588321+0000","last_active":"2024-09-11T14:11:01.588321+0000","last_peered":"2024-09-11T14:11:01.588321+0000","last_clean":"2024-09-11T14:11:01.588321+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:11:01.588321+0000","last_undegraded":"2024-09-11T14:11:01.588321+0000","last_fullsized":"2024-09-11T14:11:01.588321+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.583745+0000","last_change":"2024-09-11T14:11:01.587060+0000","last_active":"2024-09-11T14:11:01.583745+0000","last_peered":"2024-09-11T14:11:01.583745+0000","last_clean":"2024-09-11T14:11:01.583745+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:11:01.583745+0000","last_undegraded":"2024-09-11T14:11:01.583745+0000","last_fullsized":"2024-09-11T14:11:01.583745+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.585766+0000","last_change":"2024-09-11T14:11:01.589239+0000","last_active":"2024-09-11T14:11:01.585766+0000","last_peered":"2024-09-11T14:11:01.585766+0000","last_clean":"2024-09-11T14:11:01.585766+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:11:01.585766+0000","last_undegraded":"2024-09-11T14:11:01.585766+0000","last_fullsized":"2024-09-11T14:11:01.585766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.588033+0000","last_change":"2024-09-11T14:11:01.590912+0000","last_active":"2024-09-11T14:11:01.588033+0000","last_peered":"2024-09-11T14:11:01.588033+0000","last_clean":"2024-09-11T14:11:01.588033+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:11:01.588033+0000","last_undegraded":"2024-09-11T14:11:01.588033+0000","last_fullsized":"2024-09-11T14:11:01.588033+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.581049+0000","last_change":"2024-09-11T14:10:58.605266+0000","last_active":"2024-09-11T14:11:01.581049+0000","last_peered":"2024-09-11T14:11:01.581049+0000","last_clean":"2024-09-11T14:11:01.581049+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:11:01.581049+0000","last_undegraded":"2024-09-11T14:11:01.581049+0000","last_fullsized":"2024-09-11T14:11:01.581049+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621602,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":31234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621621,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:11:03.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:11:03.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.956+0000 7facdd457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.961+0000 7facdd457640 1 Processor -- start 2024-09-11T14:11:03.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.961+0000 7facdd457640 1 -- start start 2024-09-11T14:11:03.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facdd457640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7facd8138fd0 0x7facd813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facdd457640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd8136c10 con 0x7facd81360f0 2024-09-11T14:11:03.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facdd457640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7facd80a6010 con 0x7facd8138fd0 2024-09-11T14:11:03.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facd6ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7facd81360f0 0x7facd8136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55544/0 (socket says 172.21.15.97:55544) 2024-09-11T14:11:03.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facd6ffd640 1 -- 172.21.15.97:0/2669241881 learned_addr learned my addr 172.21.15.97:0/2669241881 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:03.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facd67fc640 1 --2- 172.21.15.97:0/2669241881 >> v2:172.21.15.97:3300/0 conn(0x7facd8138fd0 0x7facd813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facd67fc640 1 -- 172.21.15.97:0/2669241881 >> v1:172.21.15.97:6789/0 conn(0x7facd81360f0 legacy=0x7facd8136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.962+0000 7facd67fc640 1 -- 172.21.15.97:0/2669241881 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd80a5c40 con 0x7facd8138fd0 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.963+0000 7facd67fc640 1 --2- 172.21.15.97:0/2669241881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd8138fd0 0x7facd813b3f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994ae350a1fa9133 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.963+0000 7facd5ffb640 1 -- 172.21.15.97:0/2669241881 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faccc009d90 con 0x7facd8138fd0 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.963+0000 7facd5ffb640 1 -- 172.21.15.97:0/2669241881 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faccc00e230 con 0x7facd8138fd0 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.963+0000 7facd5ffb640 1 -- 172.21.15.97:0/2669241881 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faccc00e4d0 con 0x7facd8138fd0 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 1 -- 172.21.15.97:0/2669241881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd8138fd0 msgr2=0x7facd813b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 1 --2- 172.21.15.97:0/2669241881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd8138fd0 0x7facd813b3f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 1 -- 172.21.15.97:0/2669241881 shutdown_connections 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 1 --2- 172.21.15.97:0/2669241881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd8138fd0 0x7facd813b3f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 1 -- 172.21.15.97:0/2669241881 >> 172.21.15.97:0/2669241881 conn(0x7facd806f850 msgr2=0x7facd809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 1 -- 172.21.15.97:0/2669241881 shutdown_connections 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 1 -- 172.21.15.97:0/2669241881 wait complete. 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.964+0000 7facdd457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.965+0000 7facdd457640 1 Processor -- start 2024-09-11T14:11:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.965+0000 7facdd457640 1 -- start start 2024-09-11T14:11:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facdd457640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd81360f0 0x7facd81ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facdd457640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7facd8125670 con 0x7facd81360f0 2024-09-11T14:11:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facd6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd81360f0 0x7facd81ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facd6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd81360f0 0x7facd81ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59446/0 (socket says 172.21.15.97:59446) 2024-09-11T14:11:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facd6ffd640 1 -- 172.21.15.97:0/521120366 learned_addr learned my addr 172.21.15.97:0/521120366 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:03.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facd6ffd640 1 -- 172.21.15.97:0/521120366 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd8121a20 con 0x7facd81360f0 2024-09-11T14:11:03.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facd6ffd640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd81360f0 0x7facd81ca950 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facbf7fe640 1 -- 172.21.15.97:0/521120366 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7facc8005a60 con 0x7facd81360f0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facbf7fe640 1 -- 172.21.15.97:0/521120366 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7facc8005bc0 con 0x7facd81360f0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd81230f0 con 0x7facd81360f0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.967+0000 7facbf7fe640 1 -- 172.21.15.97:0/521120366 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7facc8005e60 con 0x7facd81360f0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.968+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd81239a0 con 0x7facd81360f0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.968+0000 7facbf7fe640 1 -- 172.21.15.97:0/521120366 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7facc80070b0 con 0x7facd81360f0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.969+0000 7facbf7fe640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7facc403e910 0x7facc4040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.969+0000 7facbf7fe640 1 -- 172.21.15.97:0/521120366 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7facc804f530 con 0x7facd81360f0 2024-09-11T14:11:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.969+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd8136c10 con 0x7facd81360f0 2024-09-11T14:11:03.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.969+0000 7facd67fc640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7facc403e910 0x7facc4040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:03.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.970+0000 7facd67fc640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7facc403e910 0x7facc4040e20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:03.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:03.974+0000 7facbf7fe640 1 -- 172.21.15.97:0/521120366 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7facd8136c10 con 0x7facd81360f0 2024-09-11T14:11:04.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.147+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7facd81218b0 con 0x7facc403e910 2024-09-11T14:11:04.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.148+0000 7facbf7fe640 1 -- 172.21.15.97:0/521120366 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31130 (crc 0 0 0) 0x7facd81218b0 con 0x7facc403e910 2024-09-11T14:11:04.150 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:11:04.150 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:11:04.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7facc403e910 msgr2=0x7facc4040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:04.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7facc403e910 0x7facc4040e20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd81360f0 msgr2=0x7facd81ca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:04.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd81360f0 0x7facd81ca950 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 shutdown_connections 2024-09-11T14:11:04.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7facc403e910 0x7facc4040e20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 --2- 172.21.15.97:0/521120366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facd81360f0 0x7facd81ca950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 >> 172.21.15.97:0/521120366 conn(0x7facd806f850 msgr2=0x7facd81be300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:04.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 shutdown_connections 2024-09-11T14:11:04.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.150+0000 7facdd457640 1 -- 172.21.15.97:0/521120366 wait complete. 2024-09-11T14:11:04.162 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-11T14:11:03.064471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107952,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379408,"statfs":{"total":386547056640,"available":386436513792,"internally_reserved":0,"allocated":606208,"data_stored":1305710,"data_compressed":60090,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.588019+0000","last_change":"2024-09-11T14:11:01.590400+0000","last_active":"2024-09-11T14:11:01.588019+0000","last_peered":"2024-09-11T14:11:01.588019+0000","last_clean":"2024-09-11T14:11:01.588019+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:11:01.588019+0000","last_undegraded":"2024-09-11T14:11:01.588019+0000","last_fullsized":"2024-09-11T14:11:01.588019+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.585559+0000","last_change":"2024-09-11T14:11:01.587732+0000","last_active":"2024-09-11T14:11:01.585559+0000","last_peered":"2024-09-11T14:11:01.585559+0000","last_clean":"2024-09-11T14:11:01.585559+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:11:01.585559+0000","last_undegraded":"2024-09-11T14:11:01.585559+0000","last_fullsized":"2024-09-11T14:11:01.585559+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.585140+0000","last_change":"2024-09-11T14:11:01.587844+0000","last_active":"2024-09-11T14:11:01.585140+0000","last_peered":"2024-09-11T14:11:01.585140+0000","last_clean":"2024-09-11T14:11:01.585140+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:11:01.585140+0000","last_undegraded":"2024-09-11T14:11:01.585140+0000","last_fullsized":"2024-09-11T14:11:01.585140+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.580110+0000","last_change":"2024-09-11T14:11:01.585502+0000","last_active":"2024-09-11T14:11:01.580110+0000","last_peered":"2024-09-11T14:11:01.580110+0000","last_clean":"2024-09-11T14:11:01.580110+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:11:01.580110+0000","last_undegraded":"2024-09-11T14:11:01.580110+0000","last_fullsized":"2024-09-11T14:11:01.580110+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.588321+0000","last_change":"2024-09-11T14:11:01.588321+0000","last_active":"2024-09-11T14:11:01.588321+0000","last_peered":"2024-09-11T14:11:01.588321+0000","last_clean":"2024-09-11T14:11:01.588321+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:11:01.588321+0000","last_undegraded":"2024-09-11T14:11:01.588321+0000","last_fullsized":"2024-09-11T14:11:01.588321+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.583745+0000","last_change":"2024-09-11T14:11:01.587060+0000","last_active":"2024-09-11T14:11:01.583745+0000","last_peered":"2024-09-11T14:11:01.583745+0000","last_clean":"2024-09-11T14:11:01.583745+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:11:01.583745+0000","last_undegraded":"2024-09-11T14:11:01.583745+0000","last_fullsized":"2024-09-11T14:11:01.583745+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.585766+0000","last_change":"2024-09-11T14:11:01.589239+0000","last_active":"2024-09-11T14:11:01.585766+0000","last_peered":"2024-09-11T14:11:01.585766+0000","last_clean":"2024-09-11T14:11:01.585766+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:11:01.585766+0000","last_undegraded":"2024-09-11T14:11:01.585766+0000","last_fullsized":"2024-09-11T14:11:01.585766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.588033+0000","last_change":"2024-09-11T14:11:01.590912+0000","last_active":"2024-09-11T14:11:01.588033+0000","last_peered":"2024-09-11T14:11:01.588033+0000","last_clean":"2024-09-11T14:11:01.588033+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:11:01.588033+0000","last_undegraded":"2024-09-11T14:11:01.588033+0000","last_fullsized":"2024-09-11T14:11:01.588033+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":84,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-11T14:11:01.581049+0000","last_change":"2024-09-11T14:10:58.605266+0000","last_active":"2024-09-11T14:11:01.581049+0000","last_peered":"2024-09-11T14:11:01.581049+0000","last_clean":"2024-09-11T14:11:01.581049+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:11:01.581049+0000","last_undegraded":"2024-09-11T14:11:01.581049+0000","last_fullsized":"2024-09-11T14:11:01.581049+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621602,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26948,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344892,"statfs":{"total":96636764160,"available":96609169408,"internally_reserved":0,"allocated":118784,"data_stored":31234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621621,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:11:04.163 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:11:04.163 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T14:11:04.164 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T14:11:04.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T14:11:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.266+0000 7fe4c9c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:04.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.270+0000 7fe4c9c74640 1 Processor -- start 2024-09-11T14:11:04.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.270+0000 7fe4c9c74640 1 -- start start 2024-09-11T14:11:04.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4c9c74640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4c409d570 0x7fe4c413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:04.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4c9c74640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c40a0060 con 0x7fe4c409ca50 2024-09-11T14:11:04.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4c9c74640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c409fd30 con 0x7fe4c409d570 2024-09-11T14:11:04.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4c37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe4c409ca50 0x7fe4c409ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55548/0 (socket says 172.21.15.97:55548) 2024-09-11T14:11:04.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4c37fe640 1 -- 172.21.15.97:0/1361982279 learned_addr learned my addr 172.21.15.97:0/1361982279 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4bbfff640 1 --2- 172.21.15.97:0/1361982279 >> v2:172.21.15.97:3300/0 conn(0x7fe4c409d570 0x7fe4c413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4c2ffd640 1 -- 172.21.15.97:0/1361982279 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761304771 0 0) 0x7fe4c40a0060 con 0x7fe4c409ca50 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.271+0000 7fe4c2ffd640 1 -- 172.21.15.97:0/1361982279 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b0003580 con 0x7fe4c409ca50 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.272+0000 7fe4bbfff640 1 -- 172.21.15.97:0/1361982279 >> v1:172.21.15.97:6789/0 conn(0x7fe4c409ca50 legacy=0x7fe4c409ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.272+0000 7fe4bbfff640 1 -- 172.21.15.97:0/1361982279 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c409e3c0 con 0x7fe4c409d570 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.272+0000 7fe4bbfff640 1 --2- 172.21.15.97:0/1361982279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409d570 0x7fe4c413b3b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576e77f7cd53f5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.272+0000 7fe4c2ffd640 1 -- 172.21.15.97:0/1361982279 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe4ac009d80 con 0x7fe4c409d570 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.272+0000 7fe4c2ffd640 1 -- 172.21.15.97:0/1361982279 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe4ac00e230 con 0x7fe4c409d570 2024-09-11T14:11:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.272+0000 7fe4c2ffd640 1 -- 172.21.15.97:0/1361982279 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe4ac00e4d0 con 0x7fe4c409d570 2024-09-11T14:11:04.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 1 -- 172.21.15.97:0/1361982279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409d570 msgr2=0x7fe4c413b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 1 --2- 172.21.15.97:0/1361982279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409d570 0x7fe4c413b3b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 1 -- 172.21.15.97:0/1361982279 shutdown_connections 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 1 --2- 172.21.15.97:0/1361982279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409d570 0x7fe4c413b3b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 1 -- 172.21.15.97:0/1361982279 >> 172.21.15.97:0/1361982279 conn(0x7fe4c40a5230 msgr2=0x7fe4c40a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 1 -- 172.21.15.97:0/1361982279 shutdown_connections 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 1 -- 172.21.15.97:0/1361982279 wait complete. 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.273+0000 7fe4c9c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.274+0000 7fe4c9c74640 1 Processor -- start 2024-09-11T14:11:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.274+0000 7fe4c9c74640 1 -- start start 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.275+0000 7fe4c9c74640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409ca50 0x7fe4c4124df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.275+0000 7fe4c9c74640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41362c0 con 0x7fe4c409ca50 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.275+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409ca50 0x7fe4c4124df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.275+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409ca50 0x7fe4c4124df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59462/0 (socket says 172.21.15.97:59462) 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.275+0000 7fe4c37fe640 1 -- 172.21.15.97:0/3180218565 learned_addr learned my addr 172.21.15.97:0/3180218565 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.276+0000 7fe4c37fe640 1 -- 172.21.15.97:0/3180218565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c41236b0 con 0x7fe4c409ca50 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.276+0000 7fe4c37fe640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409ca50 0x7fe4c4124df0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.276+0000 7fe4c0ff9640 1 -- 172.21.15.97:0/3180218565 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe4b4005a60 con 0x7fe4c409ca50 2024-09-11T14:11:04.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.276+0000 7fe4c0ff9640 1 -- 172.21.15.97:0/3180218565 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe4b4005bc0 con 0x7fe4c409ca50 2024-09-11T14:11:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.276+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c4123060 con 0x7fe4c409ca50 2024-09-11T14:11:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.276+0000 7fe4c0ff9640 1 -- 172.21.15.97:0/3180218565 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe4b4005e60 con 0x7fe4c409ca50 2024-09-11T14:11:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.276+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c41244d0 con 0x7fe4c409ca50 2024-09-11T14:11:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.277+0000 7fe4c0ff9640 1 -- 172.21.15.97:0/3180218565 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe4b40070b0 con 0x7fe4c409ca50 2024-09-11T14:11:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.277+0000 7fe4c0ff9640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe4a403e8e0 0x7fe4a4040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:11:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.277+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c409ce60 con 0x7fe4c409ca50 2024-09-11T14:11:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.277+0000 7fe4c0ff9640 1 -- 172.21.15.97:0/3180218565 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2728+0+0 (crc 0 0 0) 0x7fe4b404f670 con 0x7fe4c409ca50 2024-09-11T14:11:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.278+0000 7fe4bbfff640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe4a403e8e0 0x7fe4a4040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:11:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.278+0000 7fe4bbfff640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe4a403e8e0 0x7fe4a4040df0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:11:04.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.282+0000 7fe4c0ff9640 1 -- 172.21.15.97:0/3180218565 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fe4b400f230 con 0x7fe4c409ca50 2024-09-11T14:11:04.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.494+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4c4125b00 con 0x7fe4c409ca50 2024-09-11T14:11:04.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.495+0000 7fe4c0ff9640 1 -- 172.21.15.97:0/3180218565 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7fe4b400d660 con 0x7fe4c409ca50 2024-09-11T14:11:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:11:04.496 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T14:11:04.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe4a403e8e0 msgr2=0x7fe4a4040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:04.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe4a403e8e0 0x7fe4a4040df0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409ca50 msgr2=0x7fe4c4124df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409ca50 0x7fe4c4124df0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 shutdown_connections 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe4a403e8e0 0x7fe4a4040df0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 --2- 172.21.15.97:0/3180218565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4c409ca50 0x7fe4c4124df0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 >> 172.21.15.97:0/3180218565 conn(0x7fe4c40a5230 msgr2=0x7fe4c40a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 shutdown_connections 2024-09-11T14:11:04.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:11:04.497+0000 7fe4c9c74640 1 -- 172.21.15.97:0/3180218565 wait complete. 2024-09-11T14:11:04.509 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T14:11:04.510 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T14:11:04.525 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-11T14:11:04.525 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T14:11:04.526 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:11:04.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:11:04.541 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-11T14:11:04.542 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:11:04.597 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-11T14:11:04.598 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-11T14:11:04.653 INFO:tasks.workunit:timeout=3h 2024-09-11T14:11:04.654 INFO:tasks.workunit:cleanup=True 2024-09-11T14:11:04.654 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-11T14:11:04.710 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T14:11:55.649 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-11T14:11:55.649 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-11T14:11:55.649 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T14:11:55.649 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T14:11:55.649 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-11T14:11:55.650 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-11T14:11:55.654 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T14:11:55.717 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T14:11:55.719 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:11:55.720 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T14:11:56.431 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T14:11:56.507 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T14:11:56.549 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:11:56.549 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:11:56.549 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T14:11:56.587 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:11:56.590 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-11T14:11:56.590 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T14:11:56.646 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-11T14:11:56.647 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-11T14:11:56.648 DEBUG:teuthology.orchestra.run.smithi097:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-11T14:11:56.706 INFO:tasks.workunit.client.0.smithi097.stderr:+ parallel=1 2024-09-11T14:11:56.706 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' --crimson = --serial ']' 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ crimson=0 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' --crimson = --crimson ']' 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ parallel=0 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ crimson=1 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ color= 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -t 1 ']' 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-11T14:11:56.707 INFO:tasks.workunit.client.0.smithi097.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-11T14:11:56.708 INFO:tasks.workunit.client.0.smithi097.stderr:+ declare -A pids 2024-09-11T14:11:56.708 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:11:56.708 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:11:56.708 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_aio 2024-09-11T14:11:56.725 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:11:56.725 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-11T14:11:56.725 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:11:56.725 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 26 tests from LibRadosAio 2024-09-11T14:11:56.725 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-11T14:11:59.254 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.TooBig (2529 ms) 2024-09-11T14:11:59.254 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-11T14:12:02.265 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.SimpleWrite (3011 ms) 2024-09-11T14:12:02.265 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-11T14:12:05.289 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.WaitForSafe (3024 ms) 2024-09-11T14:12:05.289 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-11T14:12:08.300 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTrip (3011 ms) 2024-09-11T14:12:08.300 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-11T14:12:11.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTrip2 (3020 ms) 2024-09-11T14:12:11.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-11T14:12:14.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTrip3 (3010 ms) 2024-09-11T14:12:14.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-11T14:12:17.348 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripAppend (3018 ms) 2024-09-11T14:12:17.348 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-11T14:12:20.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RemoveTest (3019 ms) 2024-09-11T14:12:20.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-11T14:12:23.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3024 ms) 2024-09-11T14:12:23.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-11T14:12:26.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RmXattr (3014 ms) 2024-09-11T14:12:26.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-11T14:12:29.422 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.XattrIter (3017 ms) 2024-09-11T14:12:29.422 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-11T14:12:32.433 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.IsComplete (3012 ms) 2024-09-11T14:12:32.433 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-11T14:12:35.449 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.IsSafe (3015 ms) 2024-09-11T14:12:35.449 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-11T14:12:38.466 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.ReturnValue (3017 ms) 2024-09-11T14:12:38.466 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.Flush 2024-09-11T14:12:41.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.Flush (3024 ms) 2024-09-11T14:12:41.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-11T14:12:44.501 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.FlushAsync (3011 ms) 2024-09-11T14:12:44.501 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-11T14:12:47.515 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3014 ms) 2024-09-11T14:12:47.515 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-11T14:12:50.525 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3010 ms) 2024-09-11T14:12:50.525 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-11T14:12:53.239 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.SimpleStat (2715 ms) 2024-09-11T14:12:53.239 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-11T14:12:56.245 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.OperateMtime (3005 ms) 2024-09-11T14:12:56.245 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-11T14:12:59.257 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.Operate2Mtime (3012 ms) 2024-09-11T14:12:59.257 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-11T14:13:02.282 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.SimpleStatNS (3026 ms) 2024-09-11T14:13:02.283 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-11T14:13:05.297 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.StatRemove (3015 ms) 2024-09-11T14:13:05.298 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-11T14:13:08.241 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.ExecuteClass (2944 ms) 2024-09-11T14:13:08.242 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-11T14:13:11.253 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.MultiWrite (3011 ms) 2024-09-11T14:13:11.253 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-11T14:13:14.267 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.AioUnlock (3010 ms) 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 26 tests from LibRadosAio (77538 ms total) 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1100: Skipped 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1132: Skipped 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-11T14:13:14.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1149: Skipped 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1182: Skipped 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1215: Skipped 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-11T14:13:14.269 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1286: Skipped 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1326: Skipped 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1366: Skipped 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-11T14:13:14.270 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1385: Skipped 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1415: Skipped 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1454: Skipped 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-11T14:13:14.271 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1498: Skipped 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1532: Skipped 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1593: Skipped 2024-09-11T14:13:14.272 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1649: Skipped 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1681: Skipped 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-11T14:13:14.273 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 42 tests from 2 test suites ran. (77538 ms total) 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 26 tests. 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-11T14:13:14.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-11T14:13:14.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-11T14:13:14.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-11T14:13:14.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-11T14:13:14.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-11T14:13:14.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-11T14:13:14.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-11T14:13:14.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-11T14:13:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:13:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:13:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_aio_pp 2024-09-11T14:13:14.284 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:13:14.285 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-11T14:13:14.285 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:13:14.285 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 32 tests from LibRadosAio 2024-09-11T14:13:14.285 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-11T14:13:17.280 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.TooBigPP (2995 ms) 2024-09-11T14:13:17.280 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-11T14:13:35.259 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.PoolQuotaPP (17980 ms) 2024-09-11T14:13:35.260 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-11T14:13:41.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.SimpleWritePP (6033 ms) 2024-09-11T14:13:41.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-11T14:13:44.307 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.WaitForSafePP (3015 ms) 2024-09-11T14:13:44.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-11T14:13:47.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripPP (3012 ms) 2024-09-11T14:13:47.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-11T14:13:50.333 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3014 ms) 2024-09-11T14:13:50.334 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-11T14:13:53.252 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2918 ms) 2024-09-11T14:13:53.252 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-11T14:13:56.264 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3012 ms) 2024-09-11T14:13:56.264 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-11T14:13:59.277 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.IsCompletePP (3014 ms) 2024-09-11T14:13:59.277 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-11T14:14:02.290 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.IsSafePP (3013 ms) 2024-09-11T14:14:02.291 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-11T14:14:05.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.ReturnValuePP (3011 ms) 2024-09-11T14:14:05.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-11T14:14:08.314 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.FlushPP (3013 ms) 2024-09-11T14:14:08.315 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-11T14:14:11.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3023 ms) 2024-09-11T14:14:11.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-11T14:14:14.260 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (2920 ms) 2024-09-11T14:14:14.260 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-11T14:14:17.267 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3009 ms) 2024-09-11T14:14:17.267 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-11T14:14:20.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3008 ms) 2024-09-11T14:14:20.275 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-11T14:14:23.259 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2984 ms) 2024-09-11T14:14:23.259 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-11T14:14:26.309 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3050 ms) 2024-09-11T14:14:26.309 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-11T14:14:29.328 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.SimpleStatPP (3019 ms) 2024-09-11T14:14:29.328 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-11T14:14:32.345 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.OperateMtime (3018 ms) 2024-09-11T14:14:32.346 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-11T14:14:35.353 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.OperateMtime2 (3007 ms) 2024-09-11T14:14:35.353 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-11T14:14:38.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.StatRemovePP (3019 ms) 2024-09-11T14:14:38.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-11T14:14:41.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3014 ms) 2024-09-11T14:14:41.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-11T14:14:44.264 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.OmapPP (2878 ms) 2024-09-11T14:14:44.264 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-11T14:14:47.280 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.MultiWritePP (3015 ms) 2024-09-11T14:14:47.280 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-11T14:14:50.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.AioUnlockPP (3015 ms) 2024-09-11T14:14:50.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-11T14:14:53.266 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2972 ms) 2024-09-11T14:14:53.266 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-11T14:14:56.272 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RacingRemovePP (3006 ms) 2024-09-11T14:14:56.272 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-11T14:14:59.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3022 ms) 2024-09-11T14:14:59.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-11T14:15:02.309 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3015 ms) 2024-09-11T14:15:02.309 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-11T14:15:04.767 INFO:tasks.workunit.client.0.smithi097.stdout:setting pool EIO 2024-09-11T14:15:14.443 INFO:tasks.workunit.client.0.smithi097.stdout:waiting for 895 2024-09-11T14:15:15.443 INFO:tasks.workunit.client.0.smithi097.stdout:waiting for 895 2024-09-11T14:15:16.444 INFO:tasks.workunit.client.0.smithi097.stdout:waiting for 895 2024-09-11T14:15:17.443 INFO:tasks.workunit.client.0.smithi097.stdout:max_success 105, min_failed 106 2024-09-11T14:15:17.652 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAio.PoolEIOFlag (15343 ms) 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 32 tests from LibRadosAio (123367 ms total) 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-11T14:15:17.699 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-11T14:15:20.281 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (2629 ms) 2024-09-11T14:15:20.281 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-11T14:15:29.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8993 ms) 2024-09-11T14:15:29.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-11T14:15:44.298 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15025 ms) 2024-09-11T14:15:44.299 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-11T14:15:47.314 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3016 ms) 2024-09-11T14:15:47.314 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosAioPP (29663 ms total) 2024-09-11T14:15:47.314 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:47.315 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosIoPP 2024-09-11T14:15:47.315 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T14:15:50.315 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.XattrListPP (2998 ms) 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosIoPP (2998 ms total) 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-11T14:15:50.316 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-11T14:15:50.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-11T14:15:50.318 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-11T14:15:50.319 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-11T14:15:50.320 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-11T14:15:50.321 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 57 tests from 4 test suites ran. (156029 ms total) 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 36 tests. 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-11T14:15:50.322 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-11T14:15:50.323 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-11T14:15:50.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-11T14:15:50.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-11T14:15:50.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-11T14:15:50.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-11T14:15:50.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-11T14:15:50.324 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:15:50.325 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:15:50.325 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_io 2024-09-11T14:15:50.338 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:15:50.338 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-11T14:15:50.339 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:15:50.339 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from LibRadosIo 2024-09-11T14:15:52.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-11T14:15:52.604 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.SimpleWrite (284 ms) 2024-09-11T14:15:52.604 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-11T14:15:52.604 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-11T14:15:52.604 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-11T14:15:52.676 INFO:tasks.workunit.client.0.smithi097.stdout:no timeout :/ 2024-09-11T14:15:52.676 INFO:tasks.workunit.client.0.smithi097.stdout:no timeout :/ 2024-09-11T14:15:52.676 INFO:tasks.workunit.client.0.smithi097.stdout:no timeout :/ 2024-09-11T14:15:52.676 INFO:tasks.workunit.client.0.smithi097.stdout:no timeout :/ 2024-09-11T14:15:52.676 INFO:tasks.workunit.client.0.smithi097.stdout:no timeout :/ 2024-09-11T14:15:52.676 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.ReadTimeout (71 ms) 2024-09-11T14:15:52.676 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-11T14:15:52.715 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.RoundTrip (39 ms) 2024-09-11T14:15:52.715 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-11T14:15:52.736 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.Checksum (21 ms) 2024-09-11T14:15:52.736 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-11T14:15:52.767 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (32 ms) 2024-09-11T14:15:52.767 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-11T14:15:52.799 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (32 ms) 2024-09-11T14:15:52.799 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-11T14:15:52.828 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.AppendRoundTrip (29 ms) 2024-09-11T14:15:52.829 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-11T14:15:52.834 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.ZeroLenZero (5 ms) 2024-09-11T14:15:52.834 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-11T14:15:52.870 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.TruncTest (37 ms) 2024-09-11T14:15:52.870 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-11T14:15:52.897 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.RemoveTest (27 ms) 2024-09-11T14:15:52.897 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-11T14:15:52.931 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (33 ms) 2024-09-11T14:15:52.931 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-11T14:15:53.020 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.RmXattr (90 ms) 2024-09-11T14:15:53.020 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-11T14:15:53.062 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIo.XattrIter (41 ms) 2024-09-11T14:15:53.334 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from LibRadosIo (741 ms total) 2024-09-11T14:15:53.334 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:53.334 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-11T14:15:53.334 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.335 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-11T14:15:53.336 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-11T14:15:53.337 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.338 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 2 test suites ran. (2993 ms total) 2024-09-11T14:15:53.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 14 tests. 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-11T14:15:53.340 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-11T14:15:53.341 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:15:53.341 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:15:53.341 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_io_pp 2024-09-11T14:15:53.354 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:15:53.354 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-11T14:15:53.354 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:15:53.354 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-11T14:15:53.354 INFO:tasks.workunit.client.0.smithi097.stdout:seed 31293 2024-09-11T14:15:55.344 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-11T14:15:55.344 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-11T14:15:55.344 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-11T14:15:55.665 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (321 ms) 2024-09-11T14:15:55.665 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-11T14:15:55.737 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.ReadOpPP (72 ms) 2024-09-11T14:15:55.737 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-11T14:15:55.761 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (25 ms) 2024-09-11T14:15:55.761 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-11T14:15:58.758 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2996 ms) 2024-09-11T14:15:58.758 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-11T14:15:58.777 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.RoundTripPP (20 ms) 2024-09-11T14:15:58.778 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-11T14:15:58.795 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (18 ms) 2024-09-11T14:15:58.796 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-11T14:15:58.821 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.Checksum (26 ms) 2024-09-11T14:15:58.821 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-11T14:15:58.841 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (20 ms) 2024-09-11T14:15:58.841 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-11T14:15:58.880 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (39 ms) 2024-09-11T14:15:58.880 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-11T14:15:58.911 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (31 ms) 2024-09-11T14:15:58.912 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-11T14:15:58.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (20 ms) 2024-09-11T14:15:58.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-11T14:15:58.966 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (34 ms) 2024-09-11T14:15:58.966 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-11T14:15:58.995 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.TruncTestPP (29 ms) 2024-09-11T14:15:58.995 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-11T14:15:59.023 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (29 ms) 2024-09-11T14:15:59.023 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-11T14:15:59.057 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (33 ms) 2024-09-11T14:15:59.057 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-11T14:15:59.145 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.RmXattrPP (89 ms) 2024-09-11T14:15:59.145 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T14:15:59.186 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.XattrListPP (40 ms) 2024-09-11T14:15:59.186 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-11T14:15:59.214 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (29 ms) 2024-09-11T14:15:59.215 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-11T14:15:59.245 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.CmpExtPP (30 ms) 2024-09-11T14:15:59.245 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-11T14:15:59.263 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (19 ms) 2024-09-11T14:15:59.263 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-11T14:15:59.289 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (25 ms) 2024-09-11T14:15:59.364 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 22 tests from LibRadosIoPP (3945 ms total) 2024-09-11T14:15:59.364 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.365 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-11T14:15:59.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-11T14:15:59.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-11T14:15:59.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:15:59.372 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 40 tests from 2 test suites ran. (6008 ms total) 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 22 tests. 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-11T14:15:59.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-11T14:15:59.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-11T14:15:59.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:15:59.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:15:59.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_asio 2024-09-11T14:15:59.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.395+0000 7fd1a2e2d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:15:59.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.410+0000 7fd1a2e2d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:15:59.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.411+0000 7fd1a2e2d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:15:59.412 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-11T14:15:59.412 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:15:59.412 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 12 tests from AsioRados 2024-09-11T14:15:59.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.412+0000 7fd1a2e2d6c0 1 Processor -- start 2024-09-11T14:15:59.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.412+0000 7fd1a2e2d6c0 1 -- start start 2024-09-11T14:15:59.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.416+0000 7fd1a2e2d6c0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaea9e0 0xb7ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:15:59.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.416+0000 7fd1a2e2d6c0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xa4d520 con 0xaea9e0 2024-09-11T14:15:59.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.416+0000 7fd19b23f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaea9e0 0xb7ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:15:59.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.416+0000 7fd19b23f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaea9e0 0xb7ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35718/0 (socket says 172.21.15.97:35718) 2024-09-11T14:15:59.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.416+0000 7fd19b23f640 1 -- 172.21.15.97:0/1743789335 learned_addr learned my addr 172.21.15.97:0/1743789335 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:15:59.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.417+0000 7fd19b23f640 1 -- 172.21.15.97:0/1743789335 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9e9e10 con 0xaea9e0 2024-09-11T14:15:59.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.417+0000 7fd19b23f640 1 --2- 172.21.15.97:0/1743789335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaea9e0 0xb7ea90 crc :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a910e328833a7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:15:59.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.418+0000 7fd199a3c640 1 -- 172.21.15.97:0/1743789335 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd18c02dcb0 con 0xaea9e0 2024-09-11T14:15:59.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.418+0000 7fd199a3c640 1 -- 172.21.15.97:0/1743789335 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd18c02de10 con 0xaea9e0 2024-09-11T14:15:59.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.418+0000 7fd199a3c640 1 -- 172.21.15.97:0/1743789335 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd18c00a170 con 0xaea9e0 2024-09-11T14:15:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.421+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1743789335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaea9e0 msgr2=0xb7ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:15:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.421+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1743789335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaea9e0 0xb7ea90 crc :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:15:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.421+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1743789335 shutdown_connections 2024-09-11T14:15:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.421+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1743789335 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaea9e0 0xb7ea90 crc :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:15:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.421+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1743789335 >> 172.21.15.97:0/1743789335 conn(0xa0d770 msgr2=0xae1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:15:59.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.421+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1743789335 shutdown_connections 2024-09-11T14:15:59.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.421+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1743789335 wait complete. 2024-09-11T14:15:59.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.423+0000 7fd1a2e2d6c0 1 Processor -- start 2024-09-11T14:15:59.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.423+0000 7fd1a2e2d6c0 1 -- start start 2024-09-11T14:15:59.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.425+0000 7fd1a2e2d6c0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaeb330 0xb825b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:15:59.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.425+0000 7fd1a2e2d6c0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xa4b280 con 0xaeb330 2024-09-11T14:15:59.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.425+0000 7fd19b23f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaeb330 0xb825b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:15:59.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.425+0000 7fd19b23f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaeb330 0xb825b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35734/0 (socket says 172.21.15.97:35734) 2024-09-11T14:15:59.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.425+0000 7fd19b23f640 1 -- 172.21.15.97:0/1577247766 learned_addr learned my addr 172.21.15.97:0/1577247766 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:15:59.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.426+0000 7fd19b23f640 1 -- 172.21.15.97:0/1577247766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9db920 con 0xaeb330 2024-09-11T14:15:59.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.426+0000 7fd19b23f640 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaeb330 0xb825b0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:15:59.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.426+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd18c03b540 con 0xaeb330 2024-09-11T14:15:59.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.426+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd18c03b6a0 con 0xaeb330 2024-09-11T14:15:59.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.426+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd18c03b540 con 0xaeb330 2024-09-11T14:15:59.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.426+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x9db380 con 0xaeb330 2024-09-11T14:15:59.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.426+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb6e7b0 con 0xaeb330 2024-09-11T14:15:59.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.428+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd18c03b860 con 0xaeb330 2024-09-11T14:15:59.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.428+0000 7fd198a3a640 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd17403d240 0x7fd17403f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:15:59.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.428+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 2700+0+0 (crc 0 0 0) 0x7fd18c032040 con 0xaeb330 2024-09-11T14:15:59.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.428+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xa43df0 con 0xaeb330 2024-09-11T14:15:59.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.429+0000 7fd19aa3e640 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd17403d240 0x7fd17403f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:15:59.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.429+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7fd18c03b540 con 0xaeb330 2024-09-11T14:15:59.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.429+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0xa56bf0 con 0xaeb330 2024-09-11T14:15:59.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:15:59.429+0000 7fd19aa3e640 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd17403d240 0x7fd17403f750 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:16:00.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:00.361+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7fd18c009cc0 con 0xaeb330 2024-09-11T14:16:00.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:00.362+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7fd174041bc0 con 0xaeb330 2024-09-11T14:16:00.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:00.362+0000 7fd198a3a640 1 -- 172.21.15.97:0/1577247766 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(236..236 src has 1..236) ==== 651+0+0 (crc 0 0 0) 0x7fd18c006de0 con 0xaeb330 2024-09-11T14:16:00.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:00.362+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1577247766 >> v2:172.21.15.97:6804/1629092190 conn(0xc1ce10 0xc1f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:16:00.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:00.362+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xb6f050 con 0xc1ce10 2024-09-11T14:16:00.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:00.365+0000 7fd19ba40640 1 --2- 172.21.15.97:0/1577247766 >> v2:172.21.15.97:6804/1629092190 conn(0xc1ce10 0xc1f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:16:00.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:00.411+0000 7fd19ba40640 1 --2- 172.21.15.97:0/1577247766 >> v2:172.21.15.97:6804/1629092190 conn(0xc1ce10 0xc1f230 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:16:01.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.576+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.578 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-11T14:16:01.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.576+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc19be0 con 0xc1ce10 2024-09-11T14:16:01.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.576+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc1a480 con 0xc1ce10 2024-09-11T14:16:01.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.592+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.592+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.594 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncReadCallback (16 ms) 2024-09-11T14:16:01.594 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-11T14:16:01.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.593+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xb82af0 con 0xc1ce10 2024-09-11T14:16:01.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.593+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc1fc20 con 0xc1ce10 2024-09-11T14:16:01.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.603+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.603+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.604 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncReadFuture (11 ms) 2024-09-11T14:16:01.605 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-11T14:16:01.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.603+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc19fb0 con 0xc1ce10 2024-09-11T14:16:01.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.603+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc60450 con 0xc1ce10 2024-09-11T14:16:01.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.614+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.614+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.615 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncReadYield (11 ms) 2024-09-11T14:16:01.615 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-11T14:16:01.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.614+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xc20f90 con 0xc1ce10 2024-09-11T14:16:01.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.629+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.631 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncWriteCallback (15 ms) 2024-09-11T14:16:01.631 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-11T14:16:01.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.630+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xc20f90 con 0xc1ce10 2024-09-11T14:16:01.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.644+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.646 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncWriteFuture (15 ms) 2024-09-11T14:16:01.646 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-11T14:16:01.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.645+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xc1f8c0 con 0xc1ce10 2024-09-11T14:16:01.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.659+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.660 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncWriteYield (15 ms) 2024-09-11T14:16:01.660 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-11T14:16:01.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.659+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc1f8c0 con 0xc1ce10 2024-09-11T14:16:01.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.659+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc20a30 con 0xc1ce10 2024-09-11T14:16:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.665+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.665+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.667 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (6 ms) 2024-09-11T14:16:01.667 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-11T14:16:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.666+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc1f8c0 con 0xc1ce10 2024-09-11T14:16:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.666+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc43620 con 0xc1ce10 2024-09-11T14:16:01.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.672+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.672+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.673 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (7 ms) 2024-09-11T14:16:01.673 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-11T14:16:01.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.672+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc43620 con 0xc1ce10 2024-09-11T14:16:01.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.672+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xc200d0 con 0xc1ce10 2024-09-11T14:16:01.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.678+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.678+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.680 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2024-09-11T14:16:01.680 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-11T14:16:01.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.678+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xc20a30 con 0xc1ce10 2024-09-11T14:16:01.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.689+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.692 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (11 ms) 2024-09-11T14:16:01.692 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-11T14:16:01.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.689+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xc20580 con 0xc1ce10 2024-09-11T14:16:01.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.701+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.702 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (12 ms) 2024-09-11T14:16:01.702 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-11T14:16:01.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.701+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xc20580 con 0xc1ce10 2024-09-11T14:16:01.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.712+0000 7fd19ba40640 1 -- 172.21.15.97:0/1577247766 <== osd.1 v2:172.21.15.97:6804/1629092190 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd17c00c430 con 0xc1ce10 2024-09-11T14:16:01.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (11 ms) 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.712+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 >> v2:172.21.15.97:6804/1629092190 conn(0xc1ce10 msgr2=0xc1f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.712+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1577247766 >> v2:172.21.15.97:6804/1629092190 conn(0xc1ce10 0xc1f230 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd17403d240 msgr2=0x7fd17403f750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd17403d240 0x7fd17403f750 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaeb330 msgr2=0xb825b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaeb330 0xb825b0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 shutdown_connections 2024-09-11T14:16:01.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1577247766 >> v2:172.21.15.97:6804/1629092190 conn(0xc1ce10 0xc1f230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd17403d240 0x7fd17403f750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 --2- 172.21.15.97:0/1577247766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xaeb330 0xb825b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 >> 172.21.15.97:0/1577247766 conn(0xa0d770 msgr2=0xae25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 shutdown_connections 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.713+0000 7fd1a2e2d6c0 1 -- 172.21.15.97:0/1577247766 wait complete. 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 12 tests from AsioRados (136 ms total) 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:01.716 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:16:01.717 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 12 tests from 1 test suite ran. (2302 ms total) 2024-09-11T14:16:01.717 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 12 tests. 2024-09-11T14:16:01.717 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:16:01.717 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:16:01.717 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_list 2024-09-11T14:16:01.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.745+0000 7f2e4ab2f9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:16:01.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.745+0000 7f2e4ab2f9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:16:01.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:01.746+0000 7f2e4ab2f9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:16:01.747 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-11T14:16:01.748 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:16:01.748 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from LibRadosList 2024-09-11T14:16:03.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-11T14:16:03.909 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosList.ListObjects (529 ms) 2024-09-11T14:16:03.909 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-11T14:16:04.121 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (212 ms) 2024-09-11T14:16:04.121 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-11T14:16:04.224 INFO:tasks.workunit.client.0.smithi097.stdout:myset foo1,foo2,foo3 2024-09-11T14:16:04.319 INFO:tasks.workunit.client.0.smithi097.stdout:foo1 2024-09-11T14:16:04.319 INFO:tasks.workunit.client.0.smithi097.stdout:foo2 2024-09-11T14:16:04.319 INFO:tasks.workunit.client.0.smithi097.stdout:foo3 2024-09-11T14:16:04.319 INFO:tasks.workunit.client.0.smithi097.stdout:myset foo1,foo4,foo5 2024-09-11T14:16:04.442 INFO:tasks.workunit.client.0.smithi097.stdout:foo4 2024-09-11T14:16:04.442 INFO:tasks.workunit.client.0.smithi097.stdout:foo5 2024-09-11T14:16:04.442 INFO:tasks.workunit.client.0.smithi097.stdout:foo1 2024-09-11T14:16:04.442 INFO:tasks.workunit.client.0.smithi097.stdout:myset foo6,foo7 2024-09-11T14:16:04.538 INFO:tasks.workunit.client.0.smithi097.stdout:foo7 2024-09-11T14:16:04.538 INFO:tasks.workunit.client.0.smithi097.stdout:foo6 2024-09-11T14:16:04.538 INFO:tasks.workunit.client.0.smithi097.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout:ns1:foo4 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout:ns1:foo5 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout:ns2:foo7 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout:ns2:foo6 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout:ns1:foo1 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout::foo1 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout::foo2 2024-09-11T14:16:04.633 INFO:tasks.workunit.client.0.smithi097.stdout::foo3 2024-09-11T14:16:04.817 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosList.ListObjectsNS (696 ms) 2024-09-11T14:16:04.817 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:1 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:10 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:13 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:7 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:14 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:0 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:15 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:11 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:5 0 2024-09-11T14:16:05.121 INFO:tasks.workunit.client.0.smithi097.stdout:8 0 2024-09-11T14:16:05.122 INFO:tasks.workunit.client.0.smithi097.stdout:6 0 2024-09-11T14:16:05.122 INFO:tasks.workunit.client.0.smithi097.stdout:3 0 2024-09-11T14:16:05.122 INFO:tasks.workunit.client.0.smithi097.stdout:4 0 2024-09-11T14:16:05.122 INFO:tasks.workunit.client.0.smithi097.stdout:12 0 2024-09-11T14:16:05.122 INFO:tasks.workunit.client.0.smithi097.stdout:9 0 2024-09-11T14:16:05.122 INFO:tasks.workunit.client.0.smithi097.stdout:2 0 2024-09-11T14:16:05.216 INFO:tasks.workunit.client.0.smithi097.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-11T14:16:05.498 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosList.ListObjectsStart (681 ms) 2024-09-11T14:16:05.498 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-11T14:16:05.692 INFO:tasks.workunit.client.0.smithi097.stdout:x cursor=MIN 2024-09-11T14:16:05.789 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-11T14:16:05.790 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-11T14:16:05.791 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-11T14:16:05.791 INFO:tasks.workunit.client.0.smithi097.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-11T14:16:05.886 INFO:tasks.workunit.client.0.smithi097.stdout:FIRST> seek to MIN oid=1 2024-09-11T14:16:05.983 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-11T14:16:05.983 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:02547ec2:::1:head 2024-09-11T14:16:06.080 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:02547ec2:::1:head -> 1 2024-09-11T14:16:06.081 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-11T14:16:06.081 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:52ea6a34:::10:head 2024-09-11T14:16:06.147 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-11T14:16:06.147 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-11T14:16:06.148 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:566253c9:::13:head 2024-09-11T14:16:06.213 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:566253c9:::13:head -> 13 2024-09-11T14:16:06.213 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-11T14:16:06.213 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-11T14:16:06.276 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-11T14:16:06.276 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-11T14:16:06.276 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:62a1935d:::14:head 2024-09-11T14:16:06.336 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:62a1935d:::14:head -> 14 2024-09-11T14:16:06.336 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-11T14:16:06.336 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:6cac518f:::0:head 2024-09-11T14:16:06.398 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:6cac518f:::0:head -> 0 2024-09-11T14:16:06.398 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-11T14:16:06.398 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:863748b0:::15:head 2024-09-11T14:16:06.445 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:863748b0:::15:head -> 15 2024-09-11T14:16:06.445 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-11T14:16:06.445 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:89d3ae78:::11:head 2024-09-11T14:16:06.490 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-11T14:16:06.490 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-11T14:16:06.490 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:b29083e3:::5:head 2024-09-11T14:16:06.520 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:b29083e3:::5:head -> 5 2024-09-11T14:16:06.520 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-11T14:16:06.520 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-11T14:16:06.548 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-11T14:16:06.548 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-11T14:16:06.548 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-11T14:16:06.572 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-11T14:16:06.573 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-11T14:16:06.573 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:cfc208b3:::3:head 2024-09-11T14:16:06.594 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-11T14:16:06.594 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-11T14:16:06.594 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:d83876eb:::4:head 2024-09-11T14:16:06.609 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:d83876eb:::4:head -> 4 2024-09-11T14:16:06.610 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-11T14:16:06.610 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-11T14:16:06.625 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-11T14:16:06.625 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-11T14:16:06.625 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:e960b815:::9:head 2024-09-11T14:16:06.634 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:e960b815:::9:head -> 9 2024-09-11T14:16:06.634 INFO:tasks.workunit.client.0.smithi097.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-11T14:16:06.634 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:f905c69b:::2:head 2024-09-11T14:16:06.636 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:f905c69b:::2:head -> 2 2024-09-11T14:16:06.636 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:02547ec2:::1:head 2024-09-11T14:16:06.637 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-11T14:16:06.732 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:02547ec2:::1:head -> 1 2024-09-11T14:16:06.732 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=1 expected=1 2024-09-11T14:16:06.732 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:566253c9:::13:head 2024-09-11T14:16:06.732 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-11T14:16:06.799 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:566253c9:::13:head -> 13 2024-09-11T14:16:06.799 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=13 expected=13 2024-09-11T14:16:06.799 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:52ea6a34:::10:head 2024-09-11T14:16:06.799 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-11T14:16:06.864 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-11T14:16:06.865 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=10 expected=10 2024-09-11T14:16:06.865 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-11T14:16:06.865 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-11T14:16:06.879 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-11T14:16:06.880 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=12 expected=12 2024-09-11T14:16:06.880 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-11T14:16:06.880 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-11T14:16:06.907 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-11T14:16:06.907 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=8 expected=8 2024-09-11T14:16:06.907 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:f905c69b:::2:head 2024-09-11T14:16:06.907 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-11T14:16:06.910 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:f905c69b:::2:head -> 2 2024-09-11T14:16:06.910 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=2 expected=2 2024-09-11T14:16:06.910 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:e960b815:::9:head 2024-09-11T14:16:06.910 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-11T14:16:06.919 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:e960b815:::9:head -> 9 2024-09-11T14:16:06.919 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=9 expected=9 2024-09-11T14:16:06.919 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:b29083e3:::5:head 2024-09-11T14:16:06.919 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-11T14:16:06.950 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:b29083e3:::5:head -> 5 2024-09-11T14:16:06.950 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=5 expected=5 2024-09-11T14:16:06.950 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:d83876eb:::4:head 2024-09-11T14:16:06.951 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-11T14:16:06.966 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:d83876eb:::4:head -> 4 2024-09-11T14:16:06.966 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=4 expected=4 2024-09-11T14:16:06.966 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:cfc208b3:::3:head 2024-09-11T14:16:06.966 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-11T14:16:06.987 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-11T14:16:06.988 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=3 expected=3 2024-09-11T14:16:06.988 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-11T14:16:06.988 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-11T14:16:07.012 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-11T14:16:07.012 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=6 expected=6 2024-09-11T14:16:07.012 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:89d3ae78:::11:head 2024-09-11T14:16:07.012 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-11T14:16:07.058 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-11T14:16:07.058 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=11 expected=11 2024-09-11T14:16:07.058 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:863748b0:::15:head 2024-09-11T14:16:07.058 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-11T14:16:07.106 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:863748b0:::15:head -> 15 2024-09-11T14:16:07.106 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=15 expected=15 2024-09-11T14:16:07.106 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:6cac518f:::0:head 2024-09-11T14:16:07.107 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-11T14:16:07.164 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:6cac518f:::0:head -> 0 2024-09-11T14:16:07.164 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=0 expected=0 2024-09-11T14:16:07.164 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:62a1935d:::14:head 2024-09-11T14:16:07.164 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-11T14:16:07.224 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:62a1935d:::14:head -> 14 2024-09-11T14:16:07.224 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=14 expected=14 2024-09-11T14:16:07.224 INFO:tasks.workunit.client.0.smithi097.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-11T14:16:07.224 INFO:tasks.workunit.client.0.smithi097.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-11T14:16:07.287 INFO:tasks.workunit.client.0.smithi097.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-11T14:16:07.287 INFO:tasks.workunit.client.0.smithi097.stdout:: entry=7 expected=7 2024-09-11T14:16:07.567 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosList.ListObjectsCursor (2070 ms) 2024-09-11T14:16:07.567 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-11T14:16:08.146 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosList.EnumerateObjects (579 ms) 2024-09-11T14:16:08.146 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-11T14:16:08.345 INFO:tasks.workunit.client.0.smithi097.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-11T14:16:08.366 INFO:tasks.workunit.client.0.smithi097.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-11T14:16:08.388 INFO:tasks.workunit.client.0.smithi097.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-11T14:16:08.412 INFO:tasks.workunit.client.0.smithi097.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-11T14:16:08.433 INFO:tasks.workunit.client.0.smithi097.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-11T14:16:08.738 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (591 ms) 2024-09-11T14:16:09.660 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from LibRadosList (5358 ms total) 2024-09-11T14:16:09.660 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:09.660 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosListEC 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:70: Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:16:09.661 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:78: Skipped 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosListNP 2024-09-11T14:16:09.662 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-11T14:16:12.689 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosListNP.ListObjectsError (3030 ms) 2024-09-11T14:16:12.689 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosListNP (3030 ms total) 2024-09-11T14:16:12.689 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:12.689 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:16:12.690 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 3 test suites ran. (10943 ms total) 2024-09-11T14:16:12.690 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 8 tests. 2024-09-11T14:16:12.690 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-11T14:16:12.690 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-11T14:16:12.690 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-11T14:16:12.690 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-11T14:16:12.692 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:16:12.692 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:16:12.692 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_lock 2024-09-11T14:16:12.713 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:16:12.713 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:16:12.713 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:16:12.713 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLock 2024-09-11T14:16:14.696 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-11T14:16:14.917 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.LockExclusive (221 ms) 2024-09-11T14:16:14.917 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-11T14:16:14.955 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.LockShared (38 ms) 2024-09-11T14:16:14.955 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-11T14:16:15.999 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1044 ms) 2024-09-11T14:16:15.999 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-11T14:16:17.049 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.LockSharedDur (1050 ms) 2024-09-11T14:16:17.050 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-11T14:16:17.091 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.LockMayRenew (41 ms) 2024-09-11T14:16:17.091 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-11T14:16:17.139 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.Unlock (48 ms) 2024-09-11T14:16:17.139 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-11T14:16:17.205 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.ListLockers (67 ms) 2024-09-11T14:16:17.205 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-11T14:16:17.240 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLock.BreakLock (35 ms) 2024-09-11T14:16:17.709 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLock (2544 ms total) 2024-09-11T14:16:17.709 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:17.709 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.710 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-11T14:16:17.711 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.712 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:16:17.713 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 16 tests from 2 test suites ran. (4995 ms total) 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 8 tests. 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-11T14:16:17.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-11T14:16:17.715 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:16:17.715 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:16:17.715 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_lock_pp 2024-09-11T14:16:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:16:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:16:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:16:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-11T14:16:17.731 INFO:tasks.workunit.client.0.smithi097.stdout:seed 31408 2024-09-11T14:16:19.725 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-11T14:16:19.987 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (263 ms) 2024-09-11T14:16:19.988 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-11T14:16:20.012 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.LockSharedPP (25 ms) 2024-09-11T14:16:20.012 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-11T14:16:21.049 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1036 ms) 2024-09-11T14:16:21.049 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-11T14:16:22.090 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1040 ms) 2024-09-11T14:16:22.090 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-11T14:16:22.131 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (42 ms) 2024-09-11T14:16:22.132 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-11T14:16:22.173 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.UnlockPP (42 ms) 2024-09-11T14:16:22.174 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-11T14:16:22.235 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.ListLockersPP (61 ms) 2024-09-11T14:16:22.235 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-11T14:16:22.268 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosLockPP.BreakLockPP (34 ms) 2024-09-11T14:16:22.738 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLockPP (2544 ms total) 2024-09-11T14:16:22.738 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:22.738 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.739 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.740 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-11T14:16:22.741 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.742 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 16 tests from 2 test suites ran. (5005 ms total) 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 8 tests. 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-11T14:16:22.743 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-11T14:16:22.744 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-11T14:16:22.744 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-11T14:16:22.744 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:16:22.744 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:16:22.744 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_misc 2024-09-11T14:16:22.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:22.793+0000 7fe87a45b6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:16:22.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:22.793+0000 7fe87a45b6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:16:22.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:22.794+0000 7fe87a45b6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-11T14:16:22.796 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-11T14:16:22.847 INFO:tasks.workunit.client.0.smithi097.stderr:unable to get monitor info from DNS SRV with service name: 2024-09-11T14:16:22.845+0000 7fe87a45b6c0 -1 failed for service _ceph-mon._tcp 2024-09-11T14:16:22.847 INFO:tasks.workunit.client.0.smithi097.stderr:ceph-mon 2024-09-11T14:16:22.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:16:22.845+0000 7fe87a45b6c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-11T14:16:22.847 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (51 ms) 2024-09-11T14:16:22.847 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-11T14:16:27.855 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5008 ms) 2024-09-11T14:16:27.855 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5059 ms total) 2024-09-11T14:16:27.856 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:27.856 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-11T14:16:27.856 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-11T14:16:30.745 INFO:tasks.workunit.client.0.smithi097.stdout:started 0x7fe840005de0 2024-09-11T14:16:31.745 INFO:tasks.workunit.client.0.smithi097.stdout:started 0x7fe858005d20 2024-09-11T14:16:31.745 INFO:tasks.workunit.client.0.smithi097.stdout: started 2 aios 2024-09-11T14:16:31.745 INFO:tasks.workunit.client.0.smithi097.stdout:waiting 0x7fe840005de0 2024-09-11T14:16:31.745 INFO:tasks.workunit.client.0.smithi097.stdout:waiting 0x7fe858005d20 2024-09-11T14:16:31.748 INFO:tasks.workunit.client.0.smithi097.stdout:done. 2024-09-11T14:16:32.760 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (4906 ms) 2024-09-11T14:16:32.760 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscPool (4906 ms total) 2024-09-11T14:16:32.760 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:16:32.760 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosMisc 2024-09-11T14:16:34.284 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-11T14:16:34.284 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-11T14:16:34.284 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-11T14:16:34.604 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.Exec (320 ms) 2024-09-11T14:16:34.604 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-11T14:16:34.655 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.WriteSame (52 ms) 2024-09-11T14:16:34.656 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-11T14:16:34.679 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.CmpExt (24 ms) 2024-09-11T14:16:34.679 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-11T14:16:39.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.Applications (4639 ms) 2024-09-11T14:16:39.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-11T14:16:39.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-11T14:16:39.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-11T14:16:39.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-11T14:16:39.319 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-11T14:17:05.821 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMisc.ShutdownRace (26502 ms) 2024-09-11T14:17:06.298 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 8 tests from LibRadosMisc (31537 ms total) 2024-09-11T14:17:06.299 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:06.299 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:17:06.299 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 12 tests from 4 test suites ran. (43503 ms total) 2024-09-11T14:17:06.299 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 12 tests. 2024-09-11T14:17:06.313 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:17:06.314 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:17:06.314 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_misc_pp 2024-09-11T14:17:06.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:17:06.368+0000 7f02592e6840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:17:06.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:17:06.368+0000 7f02592e6840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:17:06.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:17:06.368+0000 7f02592e6840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:17:06.370 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-11T14:17:06.370 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:17:06.371 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-11T14:17:06.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-11T14:17:06.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-11T14:17:06.371 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T14:17:06.371 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:06.371 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-11T14:17:06.371 INFO:tasks.workunit.client.0.smithi097.stdout:seed 93074 2024-09-11T14:17:08.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-11T14:17:08.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-09-11T14:17:08.309 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-11T14:17:08.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.LongNamePP (432 ms) 2024-09-11T14:17:08.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-11T14:17:08.741 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-11T14:17:08.741 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:08.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-11T14:17:08.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-11T14:17:08.809 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (68 ms) 2024-09-11T14:17:08.809 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-11T14:17:08.859 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (51 ms) 2024-09-11T14:17:08.859 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-11T14:17:08.877 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.ExecPP (17 ms) 2024-09-11T14:17:08.877 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-11T14:17:08.893 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (16 ms) 2024-09-11T14:17:08.893 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-11T14:17:08.921 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.Operate1PP (28 ms) 2024-09-11T14:17:08.921 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-11T14:17:08.937 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.Operate2PP (17 ms) 2024-09-11T14:17:08.938 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-11T14:17:08.987 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (50 ms) 2024-09-11T14:17:08.988 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-11T14:17:09.004 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (17 ms) 2024-09-11T14:17:09.004 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-11T14:17:09.033 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (29 ms) 2024-09-11T14:17:09.034 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-11T14:17:09.085 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (51 ms) 2024-09-11T14:17:09.085 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-11T14:17:09.098 INFO:tasks.workunit.client.0.smithi097.stdout:osd_max_attr_size = 0 2024-09-11T14:17:09.098 INFO:tasks.workunit.client.0.smithi097.stdout:osd_max_attr_size == 0; skipping test 2024-09-11T14:17:29.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (20281 ms) 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-11T14:17:29.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-11T14:17:29.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (45 ms) 2024-09-11T14:17:29.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-11T14:17:29.433 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (23 ms) 2024-09-11T14:17:29.434 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-11T14:17:34.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.Applications (4860 ms) 2024-09-11T14:17:34.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-11T14:17:34.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-11T14:17:34.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-11T14:17:34.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-11T14:17:34.295 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-11T14:17:34.295 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 22 tests from LibRadosMiscPP (25985 ms total) 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-11T14:17:35.305 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:35.306 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-11T14:17:37.310 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-11T14:17:37.619 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosChecksum/0.Subset (309 ms) 2024-09-11T14:17:37.619 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-11T14:17:37.644 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosChecksum/0.Chunked (25 ms) 2024-09-11T14:17:38.315 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosChecksum/0 (334 ms total) 2024-09-11T14:17:38.315 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:38.315 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-11T14:17:40.332 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-11T14:17:40.591 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosChecksum/1.Subset (260 ms) 2024-09-11T14:17:40.591 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-11T14:17:40.623 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosChecksum/1.Chunked (32 ms) 2024-09-11T14:17:41.335 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosChecksum/1 (292 ms total) 2024-09-11T14:17:41.336 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:41.336 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-11T14:17:43.296 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-11T14:17:43.555 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosChecksum/2.Subset (261 ms) 2024-09-11T14:17:43.555 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-11T14:17:43.589 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosChecksum/2.Chunked (33 ms) 2024-09-11T14:17:44.345 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosChecksum/2 (295 ms total) 2024-09-11T14:17:44.345 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:44.345 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-11T14:17:44.345 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:17:44.345 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:44.346 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 31 tests from 7 test suites ran. (37975 ms total) 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 26 tests. 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-11T14:17:44.347 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-11T14:17:44.348 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:17:44.348 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:17:44.348 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_tier_pp 2024-09-11T14:17:44.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:17:44.390+0000 7fa7347339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:17:44.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:17:44.390+0000 7fa7347339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:17:44.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:17:44.390+0000 7fa7347339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:17:44.394 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-11T14:17:44.394 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:17:44.394 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-11T14:17:44.394 INFO:tasks.workunit.client.0.smithi097.stdout:seed 93146 2024-09-11T14:17:46.353 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-11T14:17:46.353 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-11T14:17:46.353 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:46.353 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-11T14:17:46.353 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-11T14:17:46.353 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-11T14:17:46.353 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:46.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-11T14:17:46.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-11T14:17:46.354 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-11T14:17:46.354 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:46.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-11T14:17:47.352 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-11T14:17:47.352 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:47.352 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-11T14:17:49.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-11T14:17:49.378 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.378 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.378 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.378 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-11T14:17:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (1 ms) 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-11T14:17:49.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-11T14:17:49.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-11T14:17:49.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-11T14:17:49.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-11T14:17:49.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-11T14:17:49.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.395 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.397 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:49.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-11T14:17:50.379 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-09-11T14:17:50.379 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:17:50.380 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.381 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.382 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-11T14:17:50.383 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-11T14:17:50.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.385 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.386 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-11T14:17:50.387 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.390 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.391 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-11T14:17:50.392 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 77 tests from 4 test suites ran. (5982 ms total) 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 0 tests. 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-11T14:17:50.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-11T14:17:50.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-11T14:17:50.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-11T14:17:50.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-11T14:17:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-11T14:17:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-11T14:17:50.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_pool 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRadosPools 2024-09-11T14:17:50.400 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-11T14:17:53.300 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolList (2901 ms) 2024-09-11T14:17:53.300 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-11T14:17:56.307 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolLookup (3007 ms) 2024-09-11T14:17:56.307 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-11T14:17:59.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolLookup2 (3017 ms) 2024-09-11T14:17:59.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-11T14:18:02.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3014 ms) 2024-09-11T14:18:02.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-11T14:18:05.309 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2972 ms) 2024-09-11T14:18:05.310 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-11T14:18:10.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolDelete (5015 ms) 2024-09-11T14:18:10.324 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-11T14:18:15.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4983 ms) 2024-09-11T14:18:15.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-11T14:18:20.329 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5019 ms) 2024-09-11T14:18:20.329 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-11T14:18:20.329 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/pool.cc:139: Skipped 2024-09-11T14:18:20.329 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:20.329 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRadosPools (29928 ms total) 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 1 test suite ran. (29928 ms total) 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 8 tests. 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:18:20.330 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_snapshots 2024-09-11T14:18:20.352 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:18:20.353 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-11T14:18:20.353 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:18:20.353 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-11T14:18:22.339 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-11T14:18:24.303 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshots.SnapList (1964 ms) 2024-09-11T14:18:24.303 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-11T14:18:26.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2006 ms) 2024-09-11T14:18:26.309 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-11T14:18:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshots.Rollback (2009 ms) 2024-09-11T14:18:28.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-11T14:18:30.328 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2010 ms) 2024-09-11T14:18:31.330 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosSnapshots (7989 ms total) 2024-09-11T14:18:31.330 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:18:31.330 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-11T14:18:33.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-11T14:18:37.408 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4102 ms) 2024-09-11T14:18:37.408 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-11T14:18:41.440 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4032 ms) 2024-09-11T14:18:41.440 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-11T14:18:46.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4927 ms) 2024-09-11T14:18:47.325 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13062 ms total) 2024-09-11T14:18:47.325 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:18:47.325 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-11T14:18:47.325 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:18:47.325 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.325 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-11T14:18:47.326 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:18:47.327 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-11T14:18:47.328 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:18:47.329 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 13 tests from 4 test suites ran. (26972 ms total) 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 7 tests. 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-11T14:18:47.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-11T14:18:47.331 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:18:47.331 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:18:47.331 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-11T14:18:47.351 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:18:47.351 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-11T14:18:47.351 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:18:47.351 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-11T14:18:47.351 INFO:tasks.workunit.client.0.smithi097.stdout:seed 93402 2024-09-11T14:18:49.327 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-11T14:18:51.343 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2016 ms) 2024-09-11T14:18:51.343 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-11T14:18:53.313 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (1971 ms) 2024-09-11T14:18:53.313 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-11T14:18:55.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2057 ms) 2024-09-11T14:18:55.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-11T14:18:57.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2007 ms) 2024-09-11T14:18:57.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-11T14:19:01.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4019 ms) 2024-09-11T14:19:02.399 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from LibRadosSnapshotsPP (12070 ms total) 2024-09-11T14:19:02.400 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:02.400 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-11T14:19:04.314 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-11T14:19:08.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4079 ms) 2024-09-11T14:19:08.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-11T14:19:12.349 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3956 ms) 2024-09-11T14:19:12.349 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-11T14:19:18.377 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6027 ms) 2024-09-11T14:19:18.377 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-11T14:19:22.405 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4028 ms) 2024-09-11T14:19:22.405 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-11T14:19:24.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (1985 ms) 2024-09-11T14:19:24.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-11T14:19:24.391 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-11T14:19:24.391 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:24.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-11T14:19:24.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-11T14:19:26.333 INFO:tasks.workunit.client.0.smithi097.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi097-93402-7 2024-09-11T14:19:27.338 INFO:tasks.workunit.client.0.smithi097.stdout:waiting for snaps to purge 2024-09-11T14:19:42.358 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17968 ms) 2024-09-11T14:19:43.329 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38044 ms total) 2024-09-11T14:19:43.329 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:43.329 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-11T14:19:43.329 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-11T14:19:43.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (8 ms) 2024-09-11T14:19:43.337 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5027 ms) 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5035 ms total) 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:48.365 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:19:48.367 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-11T14:19:48.368 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 21 tests from 5 test suites ran. (61013 ms total) 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 13 tests. 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-11T14:19:48.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-11T14:19:48.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-11T14:19:48.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-11T14:19:48.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-11T14:19:48.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-11T14:19:48.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-11T14:19:48.370 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:19:48.371 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:19:48.371 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_stat 2024-09-11T14:19:48.406 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:19:48.406 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-11T14:19:48.406 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:19:48.406 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from LibRadosStat 2024-09-11T14:19:50.357 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStat.Stat 2024-09-11T14:19:50.605 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStat.Stat (248 ms) 2024-09-11T14:19:50.605 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-11T14:19:50.635 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStat.Stat2 (29 ms) 2024-09-11T14:19:50.635 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-11T14:19:50.706 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStat.StatNS (72 ms) 2024-09-11T14:19:50.706 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-11T14:19:50.707 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-09-11T14:19:50.707 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-11T14:19:50.720 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStat.PoolStat (14 ms) 2024-09-11T14:19:51.369 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from LibRadosStat (363 ms total) 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:19:51.370 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.371 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 2 test suites ran. (2962 ms total) 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 5 tests. 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-11T14:19:51.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-11T14:19:51.373 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:19:51.373 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:19:51.373 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_stat_pp 2024-09-11T14:19:51.392 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:19:51.392 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-11T14:19:51.392 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:19:51.392 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-11T14:19:51.392 INFO:tasks.workunit.client.0.smithi097.stdout:seed 93538 2024-09-11T14:19:53.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-11T14:19:53.690 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStatPP.StatPP (317 ms) 2024-09-11T14:19:53.690 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-11T14:19:53.719 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (30 ms) 2024-09-11T14:19:53.719 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-11T14:19:53.720 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-11T14:19:53.720 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-11T14:19:53.734 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStatPP.PoolStatPP (14 ms) 2024-09-11T14:19:53.734 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-11T14:19:53.795 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosStatPP.StatPPNS (62 ms) 2024-09-11T14:19:54.377 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from LibRadosStatPP (423 ms total) 2024-09-11T14:19:54.377 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:54.377 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-11T14:19:54.377 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:19:54.379 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 2 test suites ran. (2985 ms total) 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 5 tests. 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-11T14:19:54.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-11T14:19:54.381 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:19:54.381 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:19:54.381 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_watch_notify 2024-09-11T14:19:54.398 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:19:54.398 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-11T14:19:54.398 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:19:54.398 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-11T14:19:56.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-11T14:19:56.681 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify_test_cb 2024-09-11T14:19:56.721 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (335 ms) 2024-09-11T14:19:56.721 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-11T14:19:56.758 INFO:tasks.workunit.client.0.smithi097.stdout:waiting up to 300 for disconnect notification ... 2024-09-11T14:19:59.444 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_errcb cookie 15351232 err -107 2024-09-11T14:19:59.768 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3047 ms) 2024-09-11T14:19:59.768 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-11T14:19:59.820 INFO:tasks.workunit.client.0.smithi097.stdout:waiting up to 300 for disconnect notification ... 2024-09-11T14:20:04.445 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_errcb cookie 15362640 err -107 2024-09-11T14:20:04.829 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5060 ms) 2024-09-11T14:20:04.829 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-11T14:20:04.858 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852992 cookie 15367616 2024-09-11T14:20:04.879 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (50 ms) 2024-09-11T14:20:04.879 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-11T14:20:04.912 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852992 cookie 15389056 2024-09-11T14:20:04.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (54 ms) 2024-09-11T14:20:04.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-11T14:20:04.962 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852992 cookie 15384640 2024-09-11T14:20:04.983 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.AioNotify (51 ms) 2024-09-11T14:20:04.983 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-11T14:20:05.028 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852993 cookie 15384640 2024-09-11T14:20:05.028 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852993 cookie 15402400 2024-09-11T14:20:05.060 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (77 ms) 2024-09-11T14:20:05.060 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-11T14:20:05.086 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852993 cookie 15384640 2024-09-11T14:20:08.087 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852994 cookie 15384640 2024-09-11T14:20:08.110 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3050 ms) 2024-09-11T14:20:08.110 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-11T14:20:08.137 INFO:tasks.workunit.client.0.smithi097.stdout:waiting up to 1024 for osd to time us out ... 2024-09-11T14:20:12.149 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_errcb cookie 15384640 err -107 2024-09-11T14:20:13.169 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_cb from 15530 notify_id 1726576852994 cookie 15384640 2024-09-11T14:20:13.186 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5076 ms) 2024-09-11T14:20:13.186 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-11T14:20:13.229 INFO:tasks.workunit.client.0.smithi097.stdout:waiting up to 30 for disconnect notification ... 2024-09-11T14:20:14.447 INFO:tasks.workunit.client.0.smithi097.stdout:watch_notify2_test_errcb cookie 15384640 err -107 2024-09-11T14:20:15.239 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2053 ms) 2024-09-11T14:20:15.722 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRadosWatchNotify (18853 ms total) 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-11T14:20:15.723 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 2 test suites ran. (21324 ms total) 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 10 tests. 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-11T14:20:15.724 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-11T14:20:15.725 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:20:15.725 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:20:15.725 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-11T14:20:15.746 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:20:15.746 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:20:15.746 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:20:15.746 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.747 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:20:15.748 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.748 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-11T14:20:15.748 INFO:tasks.workunit.client.0.smithi097.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:20:15.748 INFO:tasks.workunit.client.0.smithi097.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:20:15.748 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-11T14:20:15.748 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:15.748 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-11T14:20:17.734 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-11T14:20:18.062 INFO:tasks.workunit.client.0.smithi097.stdout:notify 2024-09-11T14:20:18.077 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (344 ms) 2024-09-11T14:20:18.077 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-11T14:20:18.110 INFO:tasks.workunit.client.0.smithi097.stdout:notify 2024-09-11T14:20:18.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (48 ms) 2024-09-11T14:20:18.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-11T14:20:18.165 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (40 ms) 2024-09-11T14:20:18.166 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-11T14:20:18.205 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (39 ms) 2024-09-11T14:20:18.205 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-11T14:20:18.236 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13885856 notify_id 1739461754883 notifier_gid 15533 2024-09-11T14:20:18.251 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (47 ms) 2024-09-11T14:20:18.251 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-11T14:20:18.284 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13885856 notify_id 1739461754883 notifier_gid 15533 2024-09-11T14:20:18.301 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (50 ms) 2024-09-11T14:20:18.301 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-11T14:20:18.356 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13892400 notify_id 1739461754882 notifier_gid 15533 2024-09-11T14:20:18.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (77 ms) 2024-09-11T14:20:18.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-11T14:20:18.411 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13895712 notify_id 1739461754884 notifier_gid 15533 2024-09-11T14:20:18.426 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (48 ms) 2024-09-11T14:20:18.426 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-11T14:20:18.463 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13892400 notify_id 1739461754883 notifier_gid 15533 2024-09-11T14:20:18.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (52 ms) 2024-09-11T14:20:18.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-11T14:20:18.512 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13892400 notify_id 1739461754883 notifier_gid 15533 2024-09-11T14:20:18.528 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (50 ms) 2024-09-11T14:20:18.529 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-11T14:20:18.556 INFO:tasks.workunit.client.0.smithi097.stdout: trying... 2024-09-11T14:20:18.561 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13892320 notify_id 1739461754884 notifier_gid 15533 2024-09-11T14:20:19.558 INFO:tasks.workunit.client.0.smithi097.stdout: timed out 2024-09-11T14:20:19.572 INFO:tasks.workunit.client.0.smithi097.stdout: flushing 2024-09-11T14:20:21.561 INFO:tasks.workunit.client.0.smithi097.stdout: flushed 2024-09-11T14:20:21.561 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3033 ms) 2024-09-11T14:20:21.561 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-11T14:20:21.597 INFO:tasks.workunit.client.0.smithi097.stdout: trying... 2024-09-11T14:20:21.601 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13892320 notify_id 1739461754884 notifier_gid 15533 2024-09-11T14:20:22.599 INFO:tasks.workunit.client.0.smithi097.stdout: timed out 2024-09-11T14:20:22.615 INFO:tasks.workunit.client.0.smithi097.stdout: flushing 2024-09-11T14:20:24.601 INFO:tasks.workunit.client.0.smithi097.stdout: flushed 2024-09-11T14:20:24.601 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3040 ms) 2024-09-11T14:20:24.601 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-11T14:20:24.637 INFO:tasks.workunit.client.0.smithi097.stdout:List watches 2024-09-11T14:20:24.638 INFO:tasks.workunit.client.0.smithi097.stdout:notify2 2024-09-11T14:20:24.641 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13892320 notify_id 1739461754885 notifier_gid 15533 2024-09-11T14:20:27.647 INFO:tasks.workunit.client.0.smithi097.stdout:notify2 done 2024-09-11T14:20:27.647 INFO:tasks.workunit.client.0.smithi097.stdout:watch_check 2024-09-11T14:20:27.647 INFO:tasks.workunit.client.0.smithi097.stdout:unwatch2 2024-09-11T14:20:27.661 INFO:tasks.workunit.client.0.smithi097.stdout: flushing 2024-09-11T14:20:27.661 INFO:tasks.workunit.client.0.smithi097.stdout:done 2024-09-11T14:20:27.661 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3059 ms) 2024-09-11T14:20:27.661 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-11T14:20:27.694 INFO:tasks.workunit.client.0.smithi097.stdout:List watches 2024-09-11T14:20:27.694 INFO:tasks.workunit.client.0.smithi097.stdout:notify2 2024-09-11T14:20:27.698 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 13892320 notify_id 1743756722181 notifier_gid 15533 2024-09-11T14:20:30.705 INFO:tasks.workunit.client.0.smithi097.stdout:notify2 done 2024-09-11T14:20:30.705 INFO:tasks.workunit.client.0.smithi097.stdout:watch_check 2024-09-11T14:20:30.705 INFO:tasks.workunit.client.0.smithi097.stdout:unwatch2 2024-09-11T14:20:30.719 INFO:tasks.workunit.client.0.smithi097.stdout: flushing 2024-09-11T14:20:30.719 INFO:tasks.workunit.client.0.smithi097.stdout:done 2024-09-11T14:20:30.719 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3059 ms) 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12986 ms total) 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 16 tests from 2 test suites ran. (15601 ms total) 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 14 tests. 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-11T14:20:31.348 INFO:tasks.workunit.client.0.smithi097.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-11T14:20:31.351 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:20:31.351 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:20:31.351 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_cmd 2024-09-11T14:20:31.373 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:20:31.373 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:20:31.373 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:20:31.373 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosCmd 2024-09-11T14:20:31.374 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-11T14:20:31.441 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCmd.MonDescribe (68 ms) 2024-09-11T14:20:31.441 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-11T14:20:31.511 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCmd.OSDCmd (69 ms) 2024-09-11T14:20:31.511 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-11T14:20:34.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCmd.PGCmd (2855 ms) 2024-09-11T14:20:34.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-11T14:20:34.402 INFO:tasks.workunit.client.0.smithi097.stdout:got: 2024-09-11T14:20:33.350954+0000 mon.a [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T14:20:35.369 INFO:tasks.workunit.client.0.smithi097.stdout:got: 2024-09-11T14:20:34.401720+0000 client.admin [INF] onexx 2024-09-11T14:20:35.369 INFO:tasks.workunit.client.0.smithi097.stdout:got: 2024-09-11T14:20:34.402035+0000 mon.a [INF] from='client.? 172.21.15.97:0/197637817' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-11T14:20:36.370 INFO:tasks.workunit.client.0.smithi097.stdout:got: 2024-09-11T14:20:35.366194+0000 mon.a [INF] from='client.? 172.21.15.97:0/197637817' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-11T14:20:39.372 INFO:tasks.workunit.client.0.smithi097.stdout:got: 2024-09-11T14:20:37.370795+0000 mon.a [INF] from='client.? 172.21.15.97:0/197637817' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-11T14:20:40.379 INFO:tasks.workunit.client.0.smithi097.stdout:got: 2024-09-11T14:20:39.371539+0000 client.admin [INF] threexx 2024-09-11T14:20:40.380 INFO:tasks.workunit.client.0.smithi097.stdout:got: 2024-09-11T14:20:39.372111+0000 mon.a [INF] from='client.? 172.21.15.97:0/197637817' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-11T14:20:44.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCmd.WatchLog (10020 ms) 2024-09-11T14:20:44.386 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosCmd (13012 ms total) 2024-09-11T14:20:44.386 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:44.386 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:20:44.386 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (13012 ms total) 2024-09-11T14:20:44.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-11T14:20:44.388 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:20:44.388 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:20:44.388 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-11T14:20:44.411 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:20:44.412 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:20:44.412 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:20:44.412 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosCmd 2024-09-11T14:20:44.412 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-11T14:20:44.445 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCmd.MonDescribePP (34 ms) 2024-09-11T14:20:44.446 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-11T14:20:44.477 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCmd.OSDCmdPP (31 ms) 2024-09-11T14:20:44.477 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-11T14:20:46.566 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCmd.PGCmdPP (2090 ms) 2024-09-11T14:20:46.566 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from LibRadosCmd (2155 ms total) 2024-09-11T14:20:46.567 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:46.567 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:20:46.567 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 3 tests from 1 test suite ran. (2155 ms total) 2024-09-11T14:20:46.567 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 3 tests. 2024-09-11T14:20:46.568 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:20:46.568 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:20:46.568 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_service 2024-09-11T14:20:46.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:20:46.605+0000 7f0d11322840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:46.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:20:46.605+0000 7f0d11322840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:46.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:20:46.605+0000 7f0d11322840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:46.607 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:20:46.607 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:20:46.607 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosService 2024-09-11T14:20:46.607 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-11T14:20:51.660 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosService.RegisterEarly (5054 ms) 2024-09-11T14:20:51.660 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-11T14:20:51.688 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosService.RegisterLate (27 ms) 2024-09-11T14:20:51.688 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: cluster: 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: id: f3855fa8-d59d-46b3-8802-359d51f9681f 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: health: HEALTH_WARN 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: 1 pool(s) do not have an application enabled 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: services: 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: mgr: x(active, since 9m) 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 10m) 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: laundry: 1 daemon active (1 hosts) 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:51.842 INFO:tasks.workunit.client.0.smithi097.stdout: data: 2024-09-11T14:20:51.843 INFO:tasks.workunit.client.0.smithi097.stdout: pools: 3 pools, 41 pgs 2024-09-11T14:20:51.843 INFO:tasks.workunit.client.0.smithi097.stdout: objects: 5 objects, 577 KiB 2024-09-11T14:20:51.843 INFO:tasks.workunit.client.0.smithi097.stdout: usage: 239 MiB used, 360 GiB / 360 GiB avail 2024-09-11T14:20:51.843 INFO:tasks.workunit.client.0.smithi097.stdout: pgs: 41 active+clean 2024-09-11T14:20:51.843 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:51.843 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: cluster: 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: id: f3855fa8-d59d-46b3-8802-359d51f9681f 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: health: HEALTH_WARN 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: 1 pool(s) do not have an application enabled 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: services: 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-11T14:20:53.869 INFO:tasks.workunit.client.0.smithi097.stdout: mgr: x(active, since 10m) 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 10m) 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: data: 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: pools: 3 pools, 41 pgs 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: objects: 5 objects, 577 KiB 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: usage: 239 MiB used, 360 GiB / 360 GiB avail 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: pgs: 41 active+clean 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:53.870 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:20:53.894 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosService.StatusFormat (2207 ms) 2024-09-11T14:20:53.894 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosService.Status 2024-09-11T14:21:13.923 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosService.Status (20029 ms) 2024-09-11T14:21:13.924 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosService (27317 ms total) 2024-09-11T14:21:13.924 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:21:13.924 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:21:13.924 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (27317 ms total) 2024-09-11T14:21:13.924 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-11T14:21:13.929 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:21:13.929 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:21:13.929 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_service_pp 2024-09-11T14:21:13.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:21:13.963+0000 7f2a29c36840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:21:13.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:21:13.963+0000 7f2a29c36840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:21:13.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:21:13.964+0000 7f2a29c36840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:21:13.965 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:21:13.965 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:21:13.966 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-11T14:21:13.966 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-11T14:21:18.993 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5027 ms) 2024-09-11T14:21:18.993 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-11T14:21:19.038 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosServicePP.RegisterLate (46 ms) 2024-09-11T14:21:19.038 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-11T14:21:39.067 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosServicePP.Status (20028 ms) 2024-09-11T14:21:39.067 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-11T14:21:39.067 INFO:tasks.workunit.client.0.smithi097.stdout:attempt 0 of 20 2024-09-11T14:21:44.122 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosServicePP.Close (5056 ms) 2024-09-11T14:21:44.122 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from LibRadosServicePP (30157 ms total) 2024-09-11T14:21:44.123 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:21:44.123 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:21:44.123 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (30157 ms total) 2024-09-11T14:21:44.123 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-11T14:21:44.125 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:21:44.125 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:21:44.125 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-11T14:21:44.146 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:21:44.147 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-11T14:21:44.147 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-11T14:21:46.362 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCWriteOps.assertExists (2215 ms) 2024-09-11T14:21:46.362 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-11T14:21:49.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3018 ms) 2024-09-11T14:21:49.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-11T14:21:52.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3012 ms) 2024-09-11T14:21:52.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-11T14:21:55.409 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCWriteOps.Write (3017 ms) 2024-09-11T14:21:55.409 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-11T14:21:58.420 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCWriteOps.Exec (3011 ms) 2024-09-11T14:21:58.420 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-11T14:22:01.438 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3018 ms) 2024-09-11T14:22:01.439 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-11T14:22:11.744 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRadosCWriteOps.CmpExt (10306 ms) 2024-09-11T14:22:11.744 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from LibRadosCWriteOps (27597 ms total) 2024-09-11T14:22:11.744 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:22:11.744 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:11.745 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 8 tests from 2 test suites ran. (27597 ms total) 2024-09-11T14:22:11.745 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 8 tests. 2024-09-11T14:22:11.747 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:22:11.747 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:11.747 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-11T14:22:11.768 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:22:11.768 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-11T14:22:11.768 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:11.768 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 17 tests from CReadOpsTest 2024-09-11T14:22:13.754 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-11T14:22:13.754 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-11T14:22:13.754 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-11T14:22:14.040 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.SetOpFlags (286 ms) 2024-09-11T14:22:14.040 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-11T14:22:14.077 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.AssertExists (38 ms) 2024-09-11T14:22:14.077 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-11T14:22:14.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.AssertVersion (47 ms) 2024-09-11T14:22:14.125 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-11T14:22:14.297 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.CmpXattr (173 ms) 2024-09-11T14:22:14.297 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.Read 2024-09-11T14:22:14.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.Read (57 ms) 2024-09-11T14:22:14.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-11T14:22:14.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.Checksum (42 ms) 2024-09-11T14:22:14.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-11T14:22:14.426 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.RWOrderedRead (30 ms) 2024-09-11T14:22:14.426 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-11T14:22:14.475 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.ShortRead (49 ms) 2024-09-11T14:22:14.475 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-11T14:22:14.505 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.Exec (30 ms) 2024-09-11T14:22:14.506 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-11T14:22:14.543 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.ExecUserBuf (38 ms) 2024-09-11T14:22:14.543 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-11T14:22:14.585 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.Stat (41 ms) 2024-09-11T14:22:14.588 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-11T14:22:14.626 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.Stat2 (41 ms) 2024-09-11T14:22:14.626 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-11T14:22:14.729 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.Omap (103 ms) 2024-09-11T14:22:14.729 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-11T14:22:14.858 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.OmapNuls (130 ms) 2024-09-11T14:22:14.858 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-11T14:22:14.939 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.GetXattrs (81 ms) 2024-09-11T14:22:14.939 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-11T14:22:14.978 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CReadOpsTest.CmpExt (39 ms) 2024-09-11T14:22:15.765 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 17 tests from CReadOpsTest (1225 ms total) 2024-09-11T14:22:15.765 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:22:15.766 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:15.766 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 17 tests from 1 test suite ran. (3997 ms total) 2024-09-11T14:22:15.766 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 17 tests. 2024-09-11T14:22:15.767 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:22:15.767 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:15.767 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_list_parallel 2024-09-11T14:22:18.719 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94276]: starting. 2024-09-11T14:22:18.719 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94276]: creating pool ceph_test_rados_list_parallel.smithi097-94275 2024-09-11T14:22:18.720 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94276]: created object 0... 2024-09-11T14:22:18.720 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94276]: created object 25... 2024-09-11T14:22:18.720 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94276]: created object 49... 2024-09-11T14:22:18.720 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94276]: finishing. 2024-09-11T14:22:18.720 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94276]: shutting down. 2024-09-11T14:22:18.835 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94277]: starting. 2024-09-11T14:22:18.835 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94277]: listing objects. 2024-09-11T14:22:18.835 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94277]: listed object 0... 2024-09-11T14:22:18.835 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94277]: listed object 25... 2024-09-11T14:22:18.835 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94277]: saw 50 objects 2024-09-11T14:22:18.835 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94277]: shutting down. 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94312]: starting. 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94312]: creating pool ceph_test_rados_list_parallel.smithi097-94275 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94312]: created object 0... 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94312]: created object 25... 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94312]: created object 49... 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94312]: finishing. 2024-09-11T14:22:19.485 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94312]: shutting down. 2024-09-11T14:22:19.797 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:19.797 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94313]: starting. 2024-09-11T14:22:19.798 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94313]: listing objects. 2024-09-11T14:22:19.798 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94313]: listed object 0... 2024-09-11T14:22:19.798 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94313]: listed object 25... 2024-09-11T14:22:19.798 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94313]: saw 43 objects 2024-09-11T14:22:19.798 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94313]: shutting down. 2024-09-11T14:22:20.087 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:20.087 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94314]: starting. 2024-09-11T14:22:20.087 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94314]: removed 25 objects... 2024-09-11T14:22:20.087 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94314]: removed half of the objects 2024-09-11T14:22:20.087 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94314]: removed 50 objects... 2024-09-11T14:22:20.087 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94314]: removed 50 objects 2024-09-11T14:22:20.087 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94314]: shutting down. 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:process_6_[94363]: starting. 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:process_6_[94363]: creating pool ceph_test_rados_list_parallel.smithi097-94275 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:process_6_[94363]: created object 0... 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:process_6_[94363]: created object 25... 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:process_6_[94363]: created object 49... 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:process_6_[94363]: finishing. 2024-09-11T14:22:20.753 INFO:tasks.workunit.client.0.smithi097.stdout:process_6_[94363]: shutting down. 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:process_7_[94364]: starting. 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:process_7_[94364]: listing objects. 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:process_7_[94364]: listed object 0... 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:process_7_[94364]: listed object 25... 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:process_7_[94364]: listed object 50... 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:process_7_[94364]: saw 54 objects 2024-09-11T14:22:21.105 INFO:tasks.workunit.client.0.smithi097.stdout:process_7_[94364]: shutting down. 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:process_8_[94365]: starting. 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:process_8_[94365]: added 25 objects... 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:process_8_[94365]: added half of the objects 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:process_8_[94365]: added 50 objects... 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:process_8_[94365]: added 50 objects 2024-09-11T14:22:21.427 INFO:tasks.workunit.client.0.smithi097.stdout:process_8_[94365]: shutting down. 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:process_9_[94414]: starting. 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:process_9_[94414]: creating pool ceph_test_rados_list_parallel.smithi097-94275 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:process_9_[94414]: created object 0... 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:process_9_[94414]: created object 25... 2024-09-11T14:22:22.108 INFO:tasks.workunit.client.0.smithi097.stdout:process_9_[94414]: created object 49... 2024-09-11T14:22:22.109 INFO:tasks.workunit.client.0.smithi097.stdout:process_9_[94414]: finishing. 2024-09-11T14:22:22.109 INFO:tasks.workunit.client.0.smithi097.stdout:process_9_[94414]: shutting down. 2024-09-11T14:22:22.500 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.500 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.500 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.500 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: starting. 2024-09-11T14:22:22.500 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: listing objects. 2024-09-11T14:22:22.500 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: listed object 0... 2024-09-11T14:22:22.501 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: listed object 25... 2024-09-11T14:22:22.501 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: listed object 50... 2024-09-11T14:22:22.501 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: listed object 75... 2024-09-11T14:22:22.501 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: saw 99 objects 2024-09-11T14:22:22.501 INFO:tasks.workunit.client.0.smithi097.stdout:process_10_[94415]: shutting down. 2024-09-11T14:22:22.863 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:process_13_[94418]: starting. 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:process_13_[94418]: removed 25 objects... 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:process_13_[94418]: removed half of the objects 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:process_13_[94418]: removed 50 objects... 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:process_13_[94418]: removed 50 objects 2024-09-11T14:22:22.864 INFO:tasks.workunit.client.0.smithi097.stdout:process_13_[94418]: shutting down. 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:process_11_[94416]: starting. 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:process_11_[94416]: added 25 objects... 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:process_11_[94416]: added half of the objects 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:process_11_[94416]: added 50 objects... 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:process_11_[94416]: added 50 objects 2024-09-11T14:22:22.943 INFO:tasks.workunit.client.0.smithi097.stdout:process_11_[94416]: shutting down. 2024-09-11T14:22:22.967 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.967 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.968 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:22.968 INFO:tasks.workunit.client.0.smithi097.stdout:process_12_[94417]: starting. 2024-09-11T14:22:22.968 INFO:tasks.workunit.client.0.smithi097.stdout:process_12_[94417]: added 25 objects... 2024-09-11T14:22:22.968 INFO:tasks.workunit.client.0.smithi097.stdout:process_12_[94417]: added half of the objects 2024-09-11T14:22:22.968 INFO:tasks.workunit.client.0.smithi097.stdout:process_12_[94417]: added 50 objects... 2024-09-11T14:22:22.968 INFO:tasks.workunit.client.0.smithi097.stdout:process_12_[94417]: added 50 objects 2024-09-11T14:22:22.968 INFO:tasks.workunit.client.0.smithi097.stdout:process_12_[94417]: shutting down. 2024-09-11T14:22:23.647 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:process_14_[94499]: starting. 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:process_14_[94499]: creating pool ceph_test_rados_list_parallel.smithi097-94275 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:process_14_[94499]: created object 0... 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:process_14_[94499]: created object 25... 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:process_14_[94499]: created object 49... 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:process_14_[94499]: finishing. 2024-09-11T14:22:23.648 INFO:tasks.workunit.client.0.smithi097.stdout:process_14_[94499]: shutting down. 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: starting. 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: listing objects. 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: listed object 0... 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: listed object 25... 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: listed object 50... 2024-09-11T14:22:23.990 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: listed object 75... 2024-09-11T14:22:23.991 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: listed object 100... 2024-09-11T14:22:23.991 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: listed object 125... 2024-09-11T14:22:23.991 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: saw 150 objects 2024-09-11T14:22:23.991 INFO:tasks.workunit.client.0.smithi097.stdout:process_15_[94500]: shutting down. 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:process_16_[94501]: starting. 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:process_16_[94501]: added 25 objects... 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:process_16_[94501]: added half of the objects 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:process_16_[94501]: added 50 objects... 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:process_16_[94501]: added 50 objects 2024-09-11T14:22:24.300 INFO:tasks.workunit.client.0.smithi097.stdout:process_16_[94501]: shutting down. 2024-09-11T14:22:24.783 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.784 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.784 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.784 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.784 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:24.784 INFO:tasks.workunit.client.0.smithi097.stdout:******* SUCCESS ********** 2024-09-11T14:22:24.785 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:22:24.785 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:24.785 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-11T14:22:27.687 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94567]: starting. 2024-09-11T14:22:27.688 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94567]: creating pool ceph_test_rados_open_pools_parallel.smithi097-94566 2024-09-11T14:22:27.688 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94567]: created object 0... 2024-09-11T14:22:27.688 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94567]: created object 25... 2024-09-11T14:22:27.688 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94567]: created object 49... 2024-09-11T14:22:27.688 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94567]: finishing. 2024-09-11T14:22:27.688 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94567]: shutting down. 2024-09-11T14:22:27.796 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94568]: starting. 2024-09-11T14:22:27.796 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94568]: rados_pool_create. 2024-09-11T14:22:27.796 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94568]: rados_ioctx_create. 2024-09-11T14:22:27.796 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94568]: shutting down. 2024-09-11T14:22:30.740 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:30.740 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94603]: starting. 2024-09-11T14:22:30.741 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94603]: creating pool ceph_test_rados_open_pools_parallel.smithi097-94566 2024-09-11T14:22:30.741 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94603]: created object 0... 2024-09-11T14:22:30.741 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94603]: created object 25... 2024-09-11T14:22:30.741 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94603]: created object 49... 2024-09-11T14:22:30.741 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94603]: finishing. 2024-09-11T14:22:30.741 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94603]: shutting down. 2024-09-11T14:22:30.816 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:30.816 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94604]: starting. 2024-09-11T14:22:30.817 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94604]: rados_pool_create. 2024-09-11T14:22:30.817 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94604]: rados_ioctx_create. 2024-09-11T14:22:30.817 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94604]: shutting down. 2024-09-11T14:22:30.818 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:30.818 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:30.818 INFO:tasks.workunit.client.0.smithi097.stdout:******* SUCCESS ********** 2024-09-11T14:22:30.819 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:22:30.820 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:30.820 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-11T14:22:33.767 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94640]: starting. 2024-09-11T14:22:33.767 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94640]: creating pool ceph_test_rados_delete_pools_parallel.smithi097-94639 2024-09-11T14:22:33.767 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94640]: created object 0... 2024-09-11T14:22:33.767 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94640]: created object 25... 2024-09-11T14:22:33.767 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94640]: created object 49... 2024-09-11T14:22:33.768 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94640]: finishing. 2024-09-11T14:22:33.768 INFO:tasks.workunit.client.0.smithi097.stdout:process_1_[94640]: shutting down. 2024-09-11T14:22:33.830 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94641]: starting. 2024-09-11T14:22:33.830 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94641]: deleting pool ceph_test_rados_delete_pools_parallel.smithi097-94639 2024-09-11T14:22:33.830 INFO:tasks.workunit.client.0.smithi097.stdout:process_2_[94641]: shutting down. 2024-09-11T14:22:36.771 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:36.772 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94676]: starting. 2024-09-11T14:22:36.772 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94676]: creating pool ceph_test_rados_delete_pools_parallel.smithi097-94639 2024-09-11T14:22:36.772 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94676]: created object 0... 2024-09-11T14:22:36.772 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94676]: created object 25... 2024-09-11T14:22:36.772 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94676]: created object 49... 2024-09-11T14:22:36.772 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94676]: finishing. 2024-09-11T14:22:36.772 INFO:tasks.workunit.client.0.smithi097.stdout:process_3_[94676]: shutting down. 2024-09-11T14:22:36.910 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:36.910 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94678]: starting. 2024-09-11T14:22:36.910 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94678]: listing objects. 2024-09-11T14:22:36.910 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94678]: listed object 0... 2024-09-11T14:22:36.910 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94678]: listed object 25... 2024-09-11T14:22:36.910 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94678]: saw 50 objects 2024-09-11T14:22:36.910 INFO:tasks.workunit.client.0.smithi097.stdout:process_5_[94678]: shutting down. 2024-09-11T14:22:37.856 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:37.857 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94677]: starting. 2024-09-11T14:22:37.857 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94677]: deleting pool ceph_test_rados_delete_pools_parallel.smithi097-94639 2024-09-11T14:22:37.857 INFO:tasks.workunit.client.0.smithi097.stdout:process_4_[94677]: shutting down. 2024-09-11T14:22:37.859 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:37.859 INFO:tasks.workunit.client.0.smithi097.stdout:******************************* 2024-09-11T14:22:37.859 INFO:tasks.workunit.client.0.smithi097.stdout:******* SUCCESS ********** 2024-09-11T14:22:37.860 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:22:37.860 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:37.860 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:22:37.860 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' cls = ec_io ']' 2024-09-11T14:22:37.860 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' cls = ec_list ']' 2024-09-11T14:22:37.860 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_cls 2024-09-11T14:22:37.883 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:22:37.883 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 1 test from 1 test suite. 2024-09-11T14:22:37.883 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:37.883 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from NeoRadosCls 2024-09-11T14:22:37.883 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-11T14:22:40.882 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosCls.DNE (2999 ms) 2024-09-11T14:22:40.882 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from NeoRadosCls (2999 ms total) 2024-09-11T14:22:40.883 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:22:40.883 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:40.883 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 1 test from 1 test suite ran. (2999 ms total) 2024-09-11T14:22:40.883 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 1 test. 2024-09-11T14:22:40.885 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:22:40.886 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:40.886 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:22:40.886 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' cmd = ec_io ']' 2024-09-11T14:22:40.886 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' cmd = ec_list ']' 2024-09-11T14:22:40.886 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_cmd 2024-09-11T14:22:40.907 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:22:40.907 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:22:40.907 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:40.907 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-11T14:22:40.908 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-11T14:22:42.895 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosCmd.MonDescribe (1987 ms) 2024-09-11T14:22:42.895 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-11T14:22:44.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosCmd.OSDCmd (1464 ms) 2024-09-11T14:22:44.360 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-11T14:22:47.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosCmd.PGCmd (3013 ms) 2024-09-11T14:22:47.373 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from NeoRadosCmd (6465 ms total) 2024-09-11T14:22:47.373 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:22:47.373 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:47.373 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 3 tests from 1 test suite ran. (6465 ms total) 2024-09-11T14:22:47.373 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 3 tests. 2024-09-11T14:22:47.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:22:47.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:47.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:22:47.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' handler_error = ec_io ']' 2024-09-11T14:22:47.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' handler_error = ec_list ']' 2024-09-11T14:22:47.375 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_handler_error 2024-09-11T14:22:47.394 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:22:47.394 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 1 test from 1 test suite. 2024-09-11T14:22:47.394 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:47.394 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from neocls_handler_error 2024-09-11T14:22:47.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-11T14:22:50.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] neocls_handler_error.test_handler_error (2984 ms) 2024-09-11T14:22:50.379 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from neocls_handler_error (2984 ms total) 2024-09-11T14:22:50.379 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:22:50.379 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:50.379 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 1 test from 1 test suite ran. (2984 ms total) 2024-09-11T14:22:50.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 1 test. 2024-09-11T14:22:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:22:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:22:50.381 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' io = ec_io ']' 2024-09-11T14:22:50.382 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' io = ec_list ']' 2024-09-11T14:22:50.382 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_io 2024-09-11T14:22:50.403 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:22:50.403 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-11T14:22:50.403 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:50.403 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from NeoRadosIo 2024-09-11T14:22:50.403 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-11T14:22:51.384 INFO:tasks.workunit.client.0.smithi097.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:22:52.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.Limits (1984 ms) 2024-09-11T14:22:52.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-11T14:22:55.409 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.SimpleWrite (3021 ms) 2024-09-11T14:22:55.409 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-11T14:22:58.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.ReadOp (2957 ms) 2024-09-11T14:22:58.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-11T14:23:01.375 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.SparseRead (3010 ms) 2024-09-11T14:23:01.376 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-11T14:23:04.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.RoundTrip (3008 ms) 2024-09-11T14:23:04.384 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-11T14:23:07.400 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3016 ms) 2024-09-11T14:23:07.401 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-11T14:23:10.403 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3003 ms) 2024-09-11T14:23:10.403 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-11T14:23:13.428 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3026 ms) 2024-09-11T14:23:13.429 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-11T14:23:16.442 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3014 ms) 2024-09-11T14:23:16.442 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-11T14:23:19.470 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.Trunc (3027 ms) 2024-09-11T14:23:19.470 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-11T14:23:22.477 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.Remove (3008 ms) 2024-09-11T14:23:22.477 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-11T14:23:25.502 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3024 ms) 2024-09-11T14:23:25.502 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-11T14:23:28.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.RmXattr (2868 ms) 2024-09-11T14:23:28.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-11T14:23:31.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosIo.GetXattrs (3009 ms) 2024-09-11T14:23:31.379 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from NeoRadosIo (40975 ms total) 2024-09-11T14:23:31.379 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:23:31.379 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:31.379 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 14 tests from 1 test suite ran. (40975 ms total) 2024-09-11T14:23:31.379 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 14 tests. 2024-09-11T14:23:31.383 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:23:31.383 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:23:31.383 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:23:31.383 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' ec_io = ec_io ']' 2024-09-11T14:23:31.384 INFO:tasks.workunit.client.0.smithi097.stdout:Skipping EC with Crimson 2024-09-11T14:23:31.384 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo 'Skipping EC with Crimson' 2024-09-11T14:23:31.384 INFO:tasks.workunit.client.0.smithi097.stderr:+ continue 2024-09-11T14:23:31.384 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:23:31.385 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:23:31.385 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:23:31.385 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' list = ec_io ']' 2024-09-11T14:23:31.385 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' list = ec_list ']' 2024-09-11T14:23:31.385 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_list 2024-09-11T14:23:31.404 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:23:31.404 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:23:31.404 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:31.404 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from NeoradosList 2024-09-11T14:23:31.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-11T14:23:34.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoradosList.ListObjects (2985 ms) 2024-09-11T14:23:34.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-11T14:23:37.408 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoradosList.ListObjectsNS (3020 ms) 2024-09-11T14:23:37.409 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-11T14:23:46.766 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoradosList.ListObjectsMany (9357 ms) 2024-09-11T14:23:46.766 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 3 tests from NeoradosList (15362 ms total) 2024-09-11T14:23:46.766 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:23:46.766 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:23:46.766 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 3 tests from 1 test suite ran. (15362 ms total) 2024-09-11T14:23:46.766 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 3 tests. 2024-09-11T14:23:46.769 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:23:46.769 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:23:46.769 INFO:tasks.workunit.client.0.smithi097.stdout:Skipping EC with Crimson 2024-09-11T14:23:46.769 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' ec_list = ec_io ']' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' ec_list = ec_list ']' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo 'Skipping EC with Crimson' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ continue 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' misc = ec_io ']' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' misc = ec_list ']' 2024-09-11T14:23:46.770 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_misc 2024-09-11T14:23:46.792 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:23:46.792 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-11T14:23:46.792 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:23:46.792 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-11T14:23:46.792 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-11T14:23:48.773 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.Version (1984 ms) 2024-09-11T14:23:48.773 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-11T14:23:50.783 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2009 ms) 2024-09-11T14:23:50.783 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-11T14:23:53.377 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.LongName (2595 ms) 2024-09-11T14:23:53.378 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-11T14:23:54.380 INFO:tasks.workunit.client.0.smithi097.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:23:55.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.LongLocator (2005 ms) 2024-09-11T14:23:55.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-11T14:23:58.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.LongNamespace (3017 ms) 2024-09-11T14:23:58.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-11T14:24:01.417 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.LongAttrName (3017 ms) 2024-09-11T14:24:01.417 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-11T14:24:04.423 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.Exec (3006 ms) 2024-09-11T14:24:04.423 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-11T14:24:07.441 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.Operate1 (3018 ms) 2024-09-11T14:24:07.441 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-11T14:24:10.458 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.Operate2 (3017 ms) 2024-09-11T14:24:10.458 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-11T14:24:13.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.BigObject (2922 ms) 2024-09-11T14:24:13.380 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-11T14:24:15.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.BigAttr (2010 ms) 2024-09-11T14:24:15.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-11T14:24:16.390 INFO:tasks.workunit.client.0.smithi097.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:24:17.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosMisc.WriteSame (2005 ms) 2024-09-11T14:24:17.394 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 12 tests from NeoRadosMisc (30605 ms total) 2024-09-11T14:24:17.394 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:24:17.394 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:24:17.395 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 12 tests from 1 test suite ran. (30605 ms total) 2024-09-11T14:24:17.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 12 tests. 2024-09-11T14:24:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:24:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:24:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:24:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' pool = ec_io ']' 2024-09-11T14:24:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' pool = ec_list ']' 2024-09-11T14:24:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_pool 2024-09-11T14:24:17.419 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:24:17.419 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-11T14:24:17.419 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:24:17.420 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from NeoRadosPools 2024-09-11T14:24:17.420 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-11T14:24:19.402 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosPools.PoolList (1983 ms) 2024-09-11T14:24:19.402 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-11T14:24:21.419 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosPools.PoolLookup (2016 ms) 2024-09-11T14:24:21.419 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-11T14:24:23.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (1964 ms) 2024-09-11T14:24:23.383 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-11T14:24:27.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosPools.PoolDelete (4021 ms) 2024-09-11T14:24:27.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-11T14:24:29.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2008 ms) 2024-09-11T14:24:29.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-11T14:24:31.420 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2009 ms) 2024-09-11T14:24:31.421 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from NeoRadosPools (14001 ms total) 2024-09-11T14:24:31.421 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:24:31.421 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:24:31.421 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 6 tests from 1 test suite ran. (14001 ms total) 2024-09-11T14:24:31.421 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 6 tests. 2024-09-11T14:24:31.423 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:24:31.423 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:24:31.424 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:24:31.424 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' read_operations = ec_io ']' 2024-09-11T14:24:31.424 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' read_operations = ec_list ']' 2024-09-11T14:24:31.424 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_read_operations 2024-09-11T14:24:31.448 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:24:31.448 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-11T14:24:31.448 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:24:31.448 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-11T14:24:31.448 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-11T14:24:34.436 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2988 ms) 2024-09-11T14:24:34.436 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-11T14:24:37.460 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.AssertExists (3024 ms) 2024-09-11T14:24:37.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-11T14:24:40.468 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3007 ms) 2024-09-11T14:24:40.468 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-11T14:24:43.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.CmpXattr (2920 ms) 2024-09-11T14:24:43.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-11T14:24:46.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.Read (3006 ms) 2024-09-11T14:24:46.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-11T14:24:49.417 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.Checksum (3023 ms) 2024-09-11T14:24:49.417 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-11T14:24:52.428 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3012 ms) 2024-09-11T14:24:52.428 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-11T14:24:55.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.ShortRead (2969 ms) 2024-09-11T14:24:55.398 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-11T14:24:58.415 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.Exec (3017 ms) 2024-09-11T14:24:58.415 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-11T14:25:01.435 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.Stat (3020 ms) 2024-09-11T14:25:01.435 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-11T14:25:04.452 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.Omap (3016 ms) 2024-09-11T14:25:04.452 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-11T14:25:07.472 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3020 ms) 2024-09-11T14:25:07.472 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-11T14:25:10.479 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3008 ms) 2024-09-11T14:25:10.479 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-11T14:25:13.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosReadOps.CmpExt (2913 ms) 2024-09-11T14:25:13.392 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 14 tests from NeoRadosReadOps (41945 ms total) 2024-09-11T14:25:13.393 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:25:13.393 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:13.393 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 14 tests from 1 test suite ran. (41945 ms total) 2024-09-11T14:25:13.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 14 tests. 2024-09-11T14:25:13.398 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:25:13.398 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:13.398 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:25:13.398 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' snapshots = ec_io ']' 2024-09-11T14:25:13.398 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' snapshots = ec_list ']' 2024-09-11T14:25:13.398 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_snapshots 2024-09-11T14:25:13.417 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:25:13.417 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-11T14:25:13.418 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:13.418 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-11T14:25:13.418 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-11T14:25:18.413 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSnapshots.SnapList (4995 ms) 2024-09-11T14:25:18.414 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-11T14:25:23.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (4984 ms) 2024-09-11T14:25:23.396 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-11T14:25:27.421 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSnapshots.Rollback (4024 ms) 2024-09-11T14:25:27.421 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-11T14:25:32.441 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5021 ms) 2024-09-11T14:25:32.442 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-11T14:25:39.479 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (7037 ms) 2024-09-11T14:25:39.479 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 5 tests from NeoRadosSnapshots (26061 ms total) 2024-09-11T14:25:39.480 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:25:39.480 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-11T14:25:39.480 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-11T14:25:44.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (4925 ms) 2024-09-11T14:25:44.405 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-11T14:25:45.407 INFO:tasks.workunit.client.0.smithi097.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:25:46.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2006 ms) 2024-09-11T14:25:46.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-11T14:25:47.421 INFO:tasks.workunit.client.0.smithi097.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:25:48.422 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2012 ms) 2024-09-11T14:25:48.423 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-11T14:25:54.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5981 ms) 2024-09-11T14:25:54.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-11T14:25:58.427 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4024 ms) 2024-09-11T14:25:58.428 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-11T14:26:01.449 INFO:tasks.workunit.client.0.smithi097.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi097-95571-11. 2024-09-11T14:26:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:Waiting for snaps to purge. 2024-09-11T14:26:18.426 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19998 ms) 2024-09-11T14:26:18.426 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (38946 ms total) 2024-09-11T14:26:18.426 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:26:18.426 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:26:18.426 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 2 test suites ran. (65008 ms total) 2024-09-11T14:26:18.427 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 11 tests. 2024-09-11T14:26:18.431 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:26:18.431 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:26:18.431 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:26:18.431 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' watch_notify = ec_io ']' 2024-09-11T14:26:18.431 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' watch_notify = ec_list ']' 2024-09-11T14:26:18.431 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_watch_notify 2024-09-11T14:26:18.454 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:26:18.454 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-11T14:26:18.454 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:26:18.455 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-11T14:26:18.455 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-11T14:26:20.693 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 10511728 notify_id 2834678415366 notifier_gid 15930 2024-09-11T14:26:21.454 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (3000 ms) 2024-09-11T14:26:21.454 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-11T14:26:23.661 INFO:tasks.workunit.client.0.smithi097.stdout:Trying... 2024-09-11T14:26:23.666 INFO:tasks.workunit.client.0.smithi097.stdout:handle_notify cookie 22654032 notify_id 2847563317252 notifier_gid 15933 2024-09-11T14:26:23.666 INFO:tasks.workunit.client.0.smithi097.stdout:Waiting for 3.000000000s 2024-09-11T14:26:24.664 INFO:tasks.workunit.client.0.smithi097.stdout:Timed out. 2024-09-11T14:26:24.676 INFO:tasks.workunit.client.0.smithi097.stdout:Flushing... 2024-09-11T14:26:24.677 INFO:tasks.workunit.client.0.smithi097.stdout:Flushed... 2024-09-11T14:26:27.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6345 ms) 2024-09-11T14:26:27.800 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 2 tests from NeoRadosWatchNotify (9346 ms total) 2024-09-11T14:26:27.800 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:26:27.800 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:26:27.800 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 2 tests from 1 test suite ran. (9346 ms total) 2024-09-11T14:26:27.800 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 2 tests. 2024-09-11T14:26:27.803 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:26:27.803 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:26:27.803 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:26:27.803 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' write_operations = ec_io ']' 2024-09-11T14:26:27.803 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' write_operations = ec_list ']' 2024-09-11T14:26:27.803 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph_test_neorados_write_operations 2024-09-11T14:26:27.823 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-11T14:26:27.824 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:26:27.824 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-11T14:26:27.824 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-11T14:26:27.824 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-11T14:26:30.821 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2998 ms) 2024-09-11T14:26:30.822 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-11T14:26:33.412 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (2591 ms) 2024-09-11T14:26:33.413 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-11T14:26:36.417 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3005 ms) 2024-09-11T14:26:36.418 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-11T14:26:39.441 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWriteOps.Write (3024 ms) 2024-09-11T14:26:39.442 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-11T14:26:42.453 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWriteOps.Exec (3011 ms) 2024-09-11T14:26:42.453 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-11T14:26:45.430 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWriteOps.WriteSame (2977 ms) 2024-09-11T14:26:45.430 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-11T14:26:56.421 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] NeoRadosWriteOps.CmpExt (10992 ms) 2024-09-11T14:26:56.421 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 7 tests from NeoRadosWriteOps (28598 ms total) 2024-09-11T14:26:56.422 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-11T14:26:56.422 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-11T14:26:56.422 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 7 tests from 1 test suite ran. (28598 ms total) 2024-09-11T14:26:56.422 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 7 tests. 2024-09-11T14:26:56.425 INFO:tasks.workunit.client.0.smithi097.stderr:+ ret=0 2024-09-11T14:26:56.426 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:26:56.426 INFO:tasks.workunit.client.0.smithi097.stderr:+ exit 0 2024-09-11T14:26:56.426 INFO:tasks.workunit.client.0.smithi097.stderr:+ cleanup 2024-09-11T14:26:56.426 INFO:tasks.workunit.client.0.smithi097.stderr:+ pkill -P 30014 2024-09-11T14:26:56.448 INFO:tasks.workunit.client.0.smithi097.stderr:+ true 2024-09-11T14:26:56.448 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T14:26:56.449 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T14:26:56.526 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-11T14:26:56.528 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-11T14:26:56.528 DEBUG:teuthology.orchestra.run.smithi097:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-11T14:26:56.588 INFO:tasks.workunit.client.0.smithi097.stderr:++ uuidgen 2024-09-11T14:26:56.590 INFO:tasks.workunit.client.0.smithi097.stderr:+ p=f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:26:56.590 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool create f2397458-472b-40b3-b6c8-73884edb56f3 12 2024-09-11T14:26:56.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.703+0000 7f074fed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:56.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.715+0000 7f074fed1640 1 Processor -- start 2024-09-11T14:26:56.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.716+0000 7f074fed1640 1 -- start start 2024-09-11T14:26:56.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.717+0000 7f074fed1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0748135740 0x7f0748137b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:56.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.717+0000 7f074fed1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07480a1c20 con 0x7f074809c820 2024-09-11T14:26:56.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.717+0000 7f074fed1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f07480753f0 con 0x7f0748135740 2024-09-11T14:26:56.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.717+0000 7f074d46c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0748135740 0x7f0748137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:56.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.717+0000 7f074d46c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0748135740 0x7f0748137b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51068/0 (socket says 172.21.15.97:51068) 2024-09-11T14:26:56.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.717+0000 7f074d46c640 1 -- 172.21.15.97:0/3918502796 learned_addr learned my addr 172.21.15.97:0/3918502796 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:26:56.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.717+0000 7f074dc6d640 1 --1- 172.21.15.97:0/3918502796 >> v1:172.21.15.97:6789/0 conn(0x7f074809c820 0x7f074809cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57734/0 (socket says 172.21.15.97:57734) 2024-09-11T14:26:56.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.718+0000 7f074d46c640 1 -- 172.21.15.97:0/3918502796 >> v1:172.21.15.97:6789/0 conn(0x7f074809c820 legacy=0x7f074809cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:56.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.718+0000 7f074d46c640 1 -- 172.21.15.97:0/3918502796 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074809d850 con 0x7f0748135740 2024-09-11T14:26:56.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.718+0000 7f074d46c640 1 --2- 172.21.15.97:0/3918502796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0748135740 0x7f0748137b60 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307efd668061682c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:56.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.718+0000 7f074cc6b640 1 -- 172.21.15.97:0/3918502796 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0738009e50 con 0x7f0748135740 2024-09-11T14:26:56.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.718+0000 7f074cc6b640 1 -- 172.21.15.97:0/3918502796 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f073800e230 con 0x7f0748135740 2024-09-11T14:26:56.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.718+0000 7f074cc6b640 1 -- 172.21.15.97:0/3918502796 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f073800e4d0 con 0x7f0748135740 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 1 -- 172.21.15.97:0/3918502796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0748135740 msgr2=0x7f0748137b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 1 --2- 172.21.15.97:0/3918502796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0748135740 0x7f0748137b60 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 1 -- 172.21.15.97:0/3918502796 shutdown_connections 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 1 --2- 172.21.15.97:0/3918502796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0748135740 0x7f0748137b60 unknown :-1 s=CLOSED pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 1 -- 172.21.15.97:0/3918502796 >> 172.21.15.97:0/3918502796 conn(0x7f07480a0d70 msgr2=0x7f07480a1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 1 -- 172.21.15.97:0/3918502796 shutdown_connections 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 1 -- 172.21.15.97:0/3918502796 wait complete. 2024-09-11T14:26:56.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.720+0000 7f074fed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:56.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.722+0000 7f074fed1640 1 Processor -- start 2024-09-11T14:26:56.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.722+0000 7f074fed1640 1 -- start start 2024-09-11T14:26:56.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.723+0000 7f074fed1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f074809c820 0x7f0748130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:56.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.723+0000 7f074fed1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0748132670 con 0x7f074809c820 2024-09-11T14:26:56.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.723+0000 7f074dc6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f074809c820 0x7f0748130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:56.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.723+0000 7f074dc6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f074809c820 0x7f0748130060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51072/0 (socket says 172.21.15.97:51072) 2024-09-11T14:26:56.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.723+0000 7f074dc6d640 1 -- 172.21.15.97:0/846257679 learned_addr learned my addr 172.21.15.97:0/846257679 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:26:56.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.724+0000 7f074dc6d640 1 -- 172.21.15.97:0/846257679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0748131a70 con 0x7f074809c820 2024-09-11T14:26:56.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.724+0000 7f074dc6d640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f074809c820 0x7f0748130060 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:56.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.724+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07440061e0 con 0x7f074809c820 2024-09-11T14:26:56.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.724+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0744006340 con 0x7f074809c820 2024-09-11T14:26:56.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.724+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07440065e0 con 0x7f074809c820 2024-09-11T14:26:56.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.724+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0748133120 con 0x7f074809c820 2024-09-11T14:26:56.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.724+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074808f5a0 con 0x7f074809c820 2024-09-11T14:26:56.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.726+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074809e310 con 0x7f074809c820 2024-09-11T14:26:56.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.726+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0744004820 con 0x7f074809c820 2024-09-11T14:26:56.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.726+0000 7f073e7fc640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f072c03e960 0x7f072c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:56.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.726+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(689..689 src has 397..689) ==== 3431+0+0 (crc 0 0 0) 0x7f074404f9b0 con 0x7f074809c820 2024-09-11T14:26:56.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.727+0000 7f074d46c640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f072c03e960 0x7f072c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:56.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.727+0000 7f074d46c640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f072c03e960 0x7f072c040e70 crc :-1 s=READY pgs=3770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:56.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.732+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f074400dc60 con 0x7f074809c820 2024-09-11T14:26:56.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:56.934+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pg_num": 12} v 0) -- 0x7f074806e5b0 con 0x7f074809c820 2024-09-11T14:26:57.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.421+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pg_num": 12}]=0 pool 'f2397458-472b-40b3-b6c8-73884edb56f3' created v690) ==== 176+0+0 (crc 0 0 0) 0x7f074400d660 con 0x7f074809c820 2024-09-11T14:26:57.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.557+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pg_num": 12} v 0) -- 0x7f07480008d0 con 0x7f074809c820 2024-09-11T14:26:57.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.557+0000 7f073e7fc640 1 -- 172.21.15.97:0/846257679 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pg_num": 12}]=0 pool 'f2397458-472b-40b3-b6c8-73884edb56f3' already exists v690) ==== 183+0+0 (crc 0 0 0) 0x7f074400d840 con 0x7f074809c820 2024-09-11T14:26:57.559 INFO:tasks.workunit.client.0.smithi097.stderr:pool 'f2397458-472b-40b3-b6c8-73884edb56f3' already exists 2024-09-11T14:26:57.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.559+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f072c03e960 msgr2=0x7f072c040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.559+0000 7f074fed1640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f072c03e960 0x7f072c040e70 crc :-1 s=READY pgs=3770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.559+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f074809c820 msgr2=0x7f0748130060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.559+0000 7f074fed1640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f074809c820 0x7f0748130060 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.560+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 shutdown_connections 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.560+0000 7f074fed1640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f072c03e960 0x7f072c040e70 unknown :-1 s=CLOSED pgs=3770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.560+0000 7f074fed1640 1 --2- 172.21.15.97:0/846257679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f074809c820 0x7f0748130060 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.560+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 >> 172.21.15.97:0/846257679 conn(0x7f07480a0d70 msgr2=0x7f0748073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.560+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 shutdown_connections 2024-09-11T14:26:57.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.560+0000 7f074fed1640 1 -- 172.21.15.97:0/846257679 wait complete. 2024-09-11T14:26:57.578 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota f2397458-472b-40b3-b6c8-73884edb56f3 max_objects 10 2024-09-11T14:26:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.672+0000 7f58d8f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.682+0000 7f58d8f51640 1 Processor -- start 2024-09-11T14:26:57.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.682+0000 7f58d8f51640 1 -- start start 2024-09-11T14:26:57.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.683+0000 7f58d8f51640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58d409c830 0x7f58d409cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d8f51640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d406ea50 con 0x7f58d41322c0 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d8f51640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f58d409d6e0 con 0x7f58d409c830 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58d409c830 0x7f58d409cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58d409c830 0x7f58d409cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51080/0 (socket says 172.21.15.97:51080) 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d259c640 1 -- 172.21.15.97:0/3631861984 learned_addr learned my addr 172.21.15.97:0/3631861984 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d1d9b640 1 --1- 172.21.15.97:0/3631861984 >> v1:172.21.15.97:6789/0 conn(0x7f58d41322c0 0x7f58d41326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57736/0 (socket says 172.21.15.97:57736) 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d259c640 1 -- 172.21.15.97:0/3631861984 >> v1:172.21.15.97:6789/0 conn(0x7f58d41322c0 legacy=0x7f58d41326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d259c640 1 -- 172.21.15.97:0/3631861984 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d409c520 con 0x7f58d409c830 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d259c640 1 --2- 172.21.15.97:0/3631861984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d409cc40 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0dd941282e114f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d159a640 1 -- 172.21.15.97:0/3631861984 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c4009e40 con 0x7f58d409c830 2024-09-11T14:26:57.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d159a640 1 -- 172.21.15.97:0/3631861984 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f58c400e230 con 0x7f58d409c830 2024-09-11T14:26:57.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.684+0000 7f58d159a640 1 -- 172.21.15.97:0/3631861984 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c400e4d0 con 0x7f58d409c830 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.685+0000 7f58d8f51640 1 -- 172.21.15.97:0/3631861984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 msgr2=0x7f58d409cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.685+0000 7f58d8f51640 1 --2- 172.21.15.97:0/3631861984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d409cc40 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.685+0000 7f58d8f51640 1 -- 172.21.15.97:0/3631861984 shutdown_connections 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.685+0000 7f58d8f51640 1 --2- 172.21.15.97:0/3631861984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d409cc40 unknown :-1 s=CLOSED pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.685+0000 7f58d8f51640 1 -- 172.21.15.97:0/3631861984 >> 172.21.15.97:0/3631861984 conn(0x7f58d40a2000 msgr2=0x7f58d40a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.685+0000 7f58d8f51640 1 -- 172.21.15.97:0/3631861984 shutdown_connections 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.685+0000 7f58d8f51640 1 -- 172.21.15.97:0/3631861984 wait complete. 2024-09-11T14:26:57.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.686+0000 7f58d8f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:57.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.687+0000 7f58d8f51640 1 Processor -- start 2024-09-11T14:26:57.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.687+0000 7f58d8f51640 1 -- start start 2024-09-11T14:26:57.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.688+0000 7f58d8f51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d41c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.688+0000 7f58d8f51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41316d0 con 0x7f58d409c830 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58d259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d41c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58d259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d41c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51092/0 (socket says 172.21.15.97:51092) 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58d259c640 1 -- 172.21.15.97:0/593895350 learned_addr learned my addr 172.21.15.97:0/593895350 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58d259c640 1 -- 172.21.15.97:0/593895350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d4131080 con 0x7f58d409c830 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58d259c640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d41c8770 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c400ed90 con 0x7f58d409c830 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d4131430 con 0x7f58d409c830 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f58c4015420 con 0x7f58d409c830 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c40156c0 con 0x7f58d409c830 2024-09-11T14:26:57.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.689+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d41307a0 con 0x7f58d409c830 2024-09-11T14:26:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.690+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d409b600 con 0x7f58d409c830 2024-09-11T14:26:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.690+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f58c40158c0 con 0x7f58d409c830 2024-09-11T14:26:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.691+0000 7f58c2ffd640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f58b403e8e0 0x7f58b4040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.691+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(690..690 src has 397..690) ==== 3806+0+0 (crc 0 0 0) 0x7f58c4051190 con 0x7f58d409c830 2024-09-11T14:26:57.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.691+0000 7f58d1d9b640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f58b403e8e0 0x7f58b4040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:57.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.691+0000 7f58d1d9b640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f58b403e8e0 0x7f58b4040df0 crc :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:57.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.696+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f58c400f2a0 con 0x7f58d409c830 2024-09-11T14:26:57.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:57.873+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "10"} v 0) -- 0x7f58d4077c10 con 0x7f58d409c830 2024-09-11T14:26:58.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:58.428+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v691) ==== 223+0+0 (crc 0 0 0) 0x7f58c40059f0 con 0x7f58d409c830 2024-09-11T14:26:58.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:58.613+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "10"} v 0) -- 0x7f58d408f630 con 0x7f58d409c830 2024-09-11T14:26:59.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.433+0000 7f58c2ffd640 1 -- 172.21.15.97:0/593895350 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v692) ==== 223+0+0 (crc 0 0 0) 0x7f58c4011df0 con 0x7f58d409c830 2024-09-11T14:26:59.436 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_objects = 10 for pool f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f58b403e8e0 msgr2=0x7f58b4040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f58b403e8e0 0x7f58b4040df0 crc :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 msgr2=0x7f58d41c8770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d41c8770 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 shutdown_connections 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f58b403e8e0 0x7f58b4040df0 unknown :-1 s=CLOSED pgs=3771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 --2- 172.21.15.97:0/593895350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58d409c830 0x7f58d41c8770 unknown :-1 s=CLOSED pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:59.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.437+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 >> 172.21.15.97:0/593895350 conn(0x7f58d40a2000 msgr2=0x7f58d40735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:26:59.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.438+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 shutdown_connections 2024-09-11T14:26:59.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.438+0000 7f58d8f51640 1 -- 172.21.15.97:0/593895350 wait complete. 2024-09-11T14:26:59.457 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool application enable f2397458-472b-40b3-b6c8-73884edb56f3 rados 2024-09-11T14:26:59.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.548+0000 7f811b27d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:59.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.558+0000 7f811b27d640 1 Processor -- start 2024-09-11T14:26:59.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.558+0000 7f811b27d640 1 -- start start 2024-09-11T14:26:59.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f811b27d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f811409dac0 0x7f8114138290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f811b27d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f811406e470 con 0x7f811409cfa0 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f811b27d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f811406e7c0 con 0x7f811409dac0 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f8118818640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f811409dac0 0x7f8114138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f8119019640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f811409cfa0 0x7f811409d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57746/0 (socket says 172.21.15.97:57746) 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f8119019640 1 -- 172.21.15.97:0/3365759448 learned_addr learned my addr 172.21.15.97:0/3365759448 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f8118818640 1 -- 172.21.15.97:0/3365759448 >> v1:172.21.15.97:6789/0 conn(0x7f811409cfa0 legacy=0x7f811409d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.559+0000 7f8118818640 1 -- 172.21.15.97:0/3365759448 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8114075320 con 0x7f811409dac0 2024-09-11T14:26:59.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f8118818640 1 --2- 172.21.15.97:0/3365759448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409dac0 0x7f8114138290 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60923aa4be85d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:59.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f810bfff640 1 -- 172.21.15.97:0/3365759448 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8104009d90 con 0x7f811409dac0 2024-09-11T14:26:59.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f810bfff640 1 -- 172.21.15.97:0/3365759448 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f810400e230 con 0x7f811409dac0 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f810bfff640 1 -- 172.21.15.97:0/3365759448 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f810400e4d0 con 0x7f811409dac0 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f811b27d640 1 -- 172.21.15.97:0/3365759448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409dac0 msgr2=0x7f8114138290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f811b27d640 1 --2- 172.21.15.97:0/3365759448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409dac0 0x7f8114138290 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f811b27d640 1 -- 172.21.15.97:0/3365759448 shutdown_connections 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.560+0000 7f811b27d640 1 --2- 172.21.15.97:0/3365759448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409dac0 0x7f8114138290 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.561+0000 7f811b27d640 1 -- 172.21.15.97:0/3365759448 >> 172.21.15.97:0/3365759448 conn(0x7f81140a2000 msgr2=0x7f81140a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.561+0000 7f811b27d640 1 -- 172.21.15.97:0/3365759448 shutdown_connections 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.561+0000 7f811b27d640 1 -- 172.21.15.97:0/3365759448 wait complete. 2024-09-11T14:26:59.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.561+0000 7f811b27d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:59.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.562+0000 7f811b27d640 1 Processor -- start 2024-09-11T14:26:59.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.562+0000 7f811b27d640 1 -- start start 2024-09-11T14:26:59.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.563+0000 7f811b27d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409cfa0 0x7f8114098fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:59.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.563+0000 7f811b27d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f81140978a0 con 0x7f811409cfa0 2024-09-11T14:26:59.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.563+0000 7f8119019640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409cfa0 0x7f8114098fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:59.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.563+0000 7f8119019640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409cfa0 0x7f8114098fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51108/0 (socket says 172.21.15.97:51108) 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.563+0000 7f8119019640 1 -- 172.21.15.97:0/2393576470 learned_addr learned my addr 172.21.15.97:0/2393576470 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.564+0000 7f8119019640 1 -- 172.21.15.97:0/2393576470 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811409abc0 con 0x7f811409cfa0 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.564+0000 7f8119019640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409cfa0 0x7f8114098fb0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.564+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8110005a60 con 0x7f811409cfa0 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.564+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8110005bc0 con 0x7f811409cfa0 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.564+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81140967b0 con 0x7f811409cfa0 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.564+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8110005e60 con 0x7f811409cfa0 2024-09-11T14:26:59.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.564+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8114097060 con 0x7f811409cfa0 2024-09-11T14:26:59.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.565+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f811000c7f0 con 0x7f811409cfa0 2024-09-11T14:26:59.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.565+0000 7f8109ffb640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f80f803e930 0x7f80f8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:26:59.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.565+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(692..692 src has 397..692) ==== 3806+0+0 (crc 0 0 0) 0x7f811004fae0 con 0x7f811409cfa0 2024-09-11T14:26:59.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.565+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8114096260 con 0x7f811409cfa0 2024-09-11T14:26:59.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.565+0000 7f8118818640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f80f803e930 0x7f80f8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:26:59.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.566+0000 7f8118818640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f80f803e930 0x7f80f8040e40 crc :-1 s=READY pgs=3772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:26:59.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.571+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f811000f230 con 0x7f811409cfa0 2024-09-11T14:26:59.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:26:59.756+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "app": "rados"} v 0) -- 0x7f8114074f90 con 0x7f811409cfa0 2024-09-11T14:27:00.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:00.434+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "app": "rados"}]=0 enabled application 'rados' on pool 'f2397458-472b-40b3-b6c8-73884edb56f3' v693) ==== 213+0+0 (crc 0 0 0) 0x7f811000d610 con 0x7f811409cfa0 2024-09-11T14:27:00.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:00.556+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "app": "rados"} v 0) -- 0x7f811406ed20 con 0x7f811409cfa0 2024-09-11T14:27:01.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.443+0000 7f8109ffb640 1 -- 172.21.15.97:0/2393576470 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "app": "rados"}]=0 enabled application 'rados' on pool 'f2397458-472b-40b3-b6c8-73884edb56f3' v694) ==== 213+0+0 (crc 0 0 0) 0x7f811000d7f0 con 0x7f811409cfa0 2024-09-11T14:27:01.444 INFO:tasks.workunit.client.0.smithi097.stderr:enabled application 'rados' on pool 'f2397458-472b-40b3-b6c8-73884edb56f3' 2024-09-11T14:27:01.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f80f803e930 msgr2=0x7f80f8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f80f803e930 0x7f80f8040e40 crc :-1 s=READY pgs=3772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409cfa0 msgr2=0x7f8114098fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409cfa0 0x7f8114098fb0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 shutdown_connections 2024-09-11T14:27:01.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f80f803e930 0x7f80f8040e40 unknown :-1 s=CLOSED pgs=3772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 --2- 172.21.15.97:0/2393576470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811409cfa0 0x7f8114098fb0 unknown :-1 s=CLOSED pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 >> 172.21.15.97:0/2393576470 conn(0x7f81140a2000 msgr2=0x7f811409f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.446+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 shutdown_connections 2024-09-11T14:27:01.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.447+0000 7f811b27d640 1 -- 172.21.15.97:0/2393576470 wait complete. 2024-09-11T14:27:01.462 INFO:tasks.workunit.client.0.smithi097.stderr:++ seq 1 10 2024-09-11T14:27:01.476 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.476 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj1 /etc/passwd 2024-09-11T14:27:01.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.515+0000 7fbecd65dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.520+0000 7fbecd65dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.520+0000 7fbecd65dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.521+0000 7fbecd65dec0 1 Processor -- start 2024-09-11T14:27:01.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.521+0000 7fbecd65dec0 1 -- start start 2024-09-11T14:27:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.522+0000 7fbecd65dec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe26850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.522+0000 7fbecd65dec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xd0d520 con 0xe3b9b0 2024-09-11T14:27:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.522+0000 7fbec579b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe26850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.522+0000 7fbec579b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe26850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:45932/0 (socket says 172.21.15.97:45932) 2024-09-11T14:27:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.522+0000 7fbec579b640 1 -- 172.21.15.97:0/2236934381 learned_addr learned my addr 172.21.15.97:0/2236934381 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.522+0000 7fbec579b640 1 -- 172.21.15.97:0/2236934381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xca9e10 con 0xe3b9b0 2024-09-11T14:27:01.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbec579b640 1 --2- 172.21.15.97:0/2236934381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe26850 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fc2a6d789aa668 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbebeffd640 1 -- 172.21.15.97:0/2236934381 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbeb000c490 con 0xe3b9b0 2024-09-11T14:27:01.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbebeffd640 1 -- 172.21.15.97:0/2236934381 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbeb000c5f0 con 0xe3b9b0 2024-09-11T14:27:01.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbebeffd640 1 -- 172.21.15.97:0/2236934381 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbeb000c890 con 0xe3b9b0 2024-09-11T14:27:01.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2236934381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 msgr2=0xe26850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2236934381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe26850 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2236934381 shutdown_connections 2024-09-11T14:27:01.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2236934381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe26850 unknown :-1 s=CLOSED pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2236934381 >> 172.21.15.97:0/2236934381 conn(0xccd770 msgr2=0xdac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2236934381 shutdown_connections 2024-09-11T14:27:01.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.523+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2236934381 wait complete. 2024-09-11T14:27:01.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.524+0000 7fbecd65dec0 1 Processor -- start 2024-09-11T14:27:01.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.524+0000 7fbecd65dec0 1 -- start start 2024-09-11T14:27:01.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.525+0000 7fbecd65dec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe29d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.525+0000 7fbecd65dec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xd0b280 con 0xe3b9b0 2024-09-11T14:27:01.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.525+0000 7fbec579b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe29d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.525+0000 7fbec579b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe29d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:45944/0 (socket says 172.21.15.97:45944) 2024-09-11T14:27:01.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.525+0000 7fbec579b640 1 -- 172.21.15.97:0/2471797240 learned_addr learned my addr 172.21.15.97:0/2471797240 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.525+0000 7fbec579b640 1 -- 172.21.15.97:0/2471797240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xc9b920 con 0xe3b9b0 2024-09-11T14:27:01.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.526+0000 7fbec579b640 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe29d50 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.526+0000 7fbebdffb640 1 -- 172.21.15.97:0/2471797240 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbeb00111e0 con 0xe3b9b0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.526+0000 7fbebdffb640 1 -- 172.21.15.97:0/2471797240 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbeb0011a00 con 0xe3b9b0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.526+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xc9b380 con 0xe3b9b0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.526+0000 7fbebdffb640 1 -- 172.21.15.97:0/2471797240 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbeb0011b70 con 0xe3b9b0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.526+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0xe2d1e0 con 0xe3b9b0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.527+0000 7fbebdffb640 1 -- 172.21.15.97:0/2471797240 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbeb0011d20 con 0xe3b9b0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.527+0000 7fbebdffb640 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbeac03d1c0 0x7fbeac03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.527+0000 7fbebdffb640 1 -- 172.21.15.97:0/2471797240 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7fbeb0050220 con 0xe3b9b0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.527+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2471797240 >> v2:172.21.15.97:6801/2470268139 conn(0xe3c4d0 0x12d4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.527+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0xe2d770 con 0xe3c4d0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.527+0000 7fbec4f9a640 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbeac03d1c0 0x7fbeac03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.528+0000 7fbec4f9a640 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbeac03d1c0 0x7fbeac03f6d0 crc :-1 s=READY pgs=3773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.528+0000 7fbec5f9c640 1 --2- 172.21.15.97:0/2471797240 >> v2:172.21.15.97:6801/2470268139 conn(0xe3c4d0 0x12d4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:01.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.531+0000 7fbec5f9c640 1 --2- 172.21.15.97:0/2471797240 >> v2:172.21.15.97:6801/2470268139 conn(0xe3c4d0 0x12d4a00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbec5f9c640 1 -- 172.21.15.97:0/2471797240 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj1 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbeb800a430 con 0xe3c4d0 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 >> v2:172.21.15.97:6801/2470268139 conn(0xe3c4d0 msgr2=0x12d4a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2471797240 >> v2:172.21.15.97:6801/2470268139 conn(0xe3c4d0 0x12d4a00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbeac03d1c0 msgr2=0x7fbeac03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbeac03d1c0 0x7fbeac03f6d0 crc :-1 s=READY pgs=3773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 msgr2=0xe29d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe29d50 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 shutdown_connections 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2471797240 >> v2:172.21.15.97:6801/2470268139 conn(0xe3c4d0 0x12d4a00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbeac03d1c0 0x7fbeac03f6d0 unknown :-1 s=CLOSED pgs=3773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 --2- 172.21.15.97:0/2471797240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xe3b9b0 0xe29d50 unknown :-1 s=CLOSED pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 >> 172.21.15.97:0/2471797240 conn(0xccd770 msgr2=0xda6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 shutdown_connections 2024-09-11T14:27:01.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.546+0000 7fbecd65dec0 1 -- 172.21.15.97:0/2471797240 wait complete. 2024-09-11T14:27:01.550 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.550 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj2 /etc/passwd 2024-09-11T14:27:01.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.584+0000 7f9cf60f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.589+0000 7f9cf60f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.589+0000 7f9cf60f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.590+0000 7f9cf60f3ec0 1 Processor -- start 2024-09-11T14:27:01.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.590+0000 7f9cf60f3ec0 1 -- start start 2024-09-11T14:27:01.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.591+0000 7f9cf60f3ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x1858590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.591+0000 7f9cf60f3ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x16a4520 con 0x1740300 2024-09-11T14:27:01.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.591+0000 7f9cee43f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x1858590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.591+0000 7f9cee43f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x1858590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:45968/0 (socket says 172.21.15.97:45968) 2024-09-11T14:27:01.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.591+0000 7f9cee43f640 1 -- 172.21.15.97:0/496754499 learned_addr learned my addr 172.21.15.97:0/496754499 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.591+0000 7f9cee43f640 1 -- 172.21.15.97:0/496754499 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1640e10 con 0x1740300 2024-09-11T14:27:01.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cee43f640 1 --2- 172.21.15.97:0/496754499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x1858590 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8f8cba4083e673 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cecc3c640 1 -- 172.21.15.97:0/496754499 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9cd802d820 con 0x1740300 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cecc3c640 1 -- 172.21.15.97:0/496754499 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9cd802daf0 con 0x1740300 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cecc3c640 1 -- 172.21.15.97:0/496754499 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9cd80374a0 con 0x1740300 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/496754499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 msgr2=0x1858590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/496754499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x1858590 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/496754499 shutdown_connections 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/496754499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x1858590 unknown :-1 s=CLOSED pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/496754499 >> 172.21.15.97:0/496754499 conn(0x1664770 msgr2=0x17426f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/496754499 shutdown_connections 2024-09-11T14:27:01.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.592+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/496754499 wait complete. 2024-09-11T14:27:01.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.593+0000 7f9cf60f3ec0 1 Processor -- start 2024-09-11T14:27:01.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.593+0000 7f9cf60f3ec0 1 -- start start 2024-09-11T14:27:01.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.594+0000 7f9cf60f3ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x17cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.594+0000 7f9cf60f3ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x16a2280 con 0x1740300 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.594+0000 7f9cee43f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x17cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.594+0000 7f9cee43f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x17cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:45976/0 (socket says 172.21.15.97:45976) 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.594+0000 7f9cee43f640 1 -- 172.21.15.97:0/1005622392 learned_addr learned my addr 172.21.15.97:0/1005622392 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.595+0000 7f9cee43f640 1 -- 172.21.15.97:0/1005622392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1632920 con 0x1740300 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.595+0000 7f9cee43f640 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x17cf100 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.595+0000 7f9ce77fe640 1 -- 172.21.15.97:0/1005622392 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9cd803e040 con 0x1740300 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.595+0000 7f9ce77fe640 1 -- 172.21.15.97:0/1005622392 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9cd8037e20 con 0x1740300 2024-09-11T14:27:01.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.595+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1632380 con 0x1740300 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.595+0000 7f9ce77fe640 1 -- 172.21.15.97:0/1005622392 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9cd8037370 con 0x1740300 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.595+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x17bbc10 con 0x1740300 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.596+0000 7f9ce77fe640 1 -- 172.21.15.97:0/1005622392 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9cd8039450 con 0x1740300 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.596+0000 7f9ce77fe640 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9cd403d1c0 0x7f9cd403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.596+0000 7f9ce77fe640 1 -- 172.21.15.97:0/1005622392 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7f9cd8000e40 con 0x1740300 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.596+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/1005622392 >> v2:172.21.15.117:6808/4196478755 conn(0x1867a60 0x1867e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.596+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0x17bf210 con 0x1867a60 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.596+0000 7f9cedc3e640 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9cd403d1c0 0x7f9cd403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.597+0000 7f9cedc3e640 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9cd403d1c0 0x7f9cd403f6d0 crc :-1 s=READY pgs=3774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.597+0000 7f9ceec40640 1 --2- 172.21.15.97:0/1005622392 >> v2:172.21.15.117:6808/4196478755 conn(0x1867a60 0x1867e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:01.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.600+0000 7f9ceec40640 1 --2- 172.21.15.97:0/1005622392 >> v2:172.21.15.117:6808/4196478755 conn(0x1867a60 0x1867e70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.614+0000 7f9ceec40640 1 -- 172.21.15.97:0/1005622392 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 obj2 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9ce000a430 con 0x1867a60 2024-09-11T14:27:01.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 >> v2:172.21.15.117:6808/4196478755 conn(0x1867a60 msgr2=0x1867e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/1005622392 >> v2:172.21.15.117:6808/4196478755 conn(0x1867a60 0x1867e70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9cd403d1c0 msgr2=0x7f9cd403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9cd403d1c0 0x7f9cd403f6d0 crc :-1 s=READY pgs=3774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 msgr2=0x17cf100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x17cf100 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 shutdown_connections 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/1005622392 >> v2:172.21.15.117:6808/4196478755 conn(0x1867a60 0x1867e70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9cd403d1c0 0x7f9cd403f6d0 unknown :-1 s=CLOSED pgs=3774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 --2- 172.21.15.97:0/1005622392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1740300 0x17cf100 unknown :-1 s=CLOSED pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 >> 172.21.15.97:0/1005622392 conn(0x1664770 msgr2=0x17426f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 shutdown_connections 2024-09-11T14:27:01.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.615+0000 7f9cf60f3ec0 1 -- 172.21.15.97:0/1005622392 wait complete. 2024-09-11T14:27:01.619 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.619 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj3 /etc/passwd 2024-09-11T14:27:01.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.653+0000 7f43eb636ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.658+0000 7f43eb636ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.658+0000 7f43eb636ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.659+0000 7f43eb636ec0 1 Processor -- start 2024-09-11T14:27:01.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.659+0000 7f43eb636ec0 1 -- start start 2024-09-11T14:27:01.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43eb636ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a81790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43eb636ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x18c5520 con 0x19f0d10 2024-09-11T14:27:01.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e379b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a81790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e379b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a81790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:45996/0 (socket says 172.21.15.97:45996) 2024-09-11T14:27:01.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e379b640 1 -- 172.21.15.97:0/3821140402 learned_addr learned my addr 172.21.15.97:0/3821140402 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e379b640 1 -- 172.21.15.97:0/3821140402 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1861e10 con 0x19f0d10 2024-09-11T14:27:01.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e379b640 1 --2- 172.21.15.97:0/3821140402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a81790 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f79a5aed907dac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e1f98640 1 -- 172.21.15.97:0/3821140402 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43cc00b580 con 0x19f0d10 2024-09-11T14:27:01.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e1f98640 1 -- 172.21.15.97:0/3821140402 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43cc00b6e0 con 0x19f0d10 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.660+0000 7f43e1f98640 1 -- 172.21.15.97:0/3821140402 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43cc00b980 con 0x19f0d10 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.661+0000 7f43eb636ec0 1 -- 172.21.15.97:0/3821140402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 msgr2=0x1a81790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.661+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/3821140402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a81790 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.661+0000 7f43eb636ec0 1 -- 172.21.15.97:0/3821140402 shutdown_connections 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.661+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/3821140402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a81790 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.661+0000 7f43eb636ec0 1 -- 172.21.15.97:0/3821140402 >> 172.21.15.97:0/3821140402 conn(0x1885770 msgr2=0x195e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.661+0000 7f43eb636ec0 1 -- 172.21.15.97:0/3821140402 shutdown_connections 2024-09-11T14:27:01.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.661+0000 7f43eb636ec0 1 -- 172.21.15.97:0/3821140402 wait complete. 2024-09-11T14:27:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.662+0000 7f43eb636ec0 1 Processor -- start 2024-09-11T14:27:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.662+0000 7f43eb636ec0 1 -- start start 2024-09-11T14:27:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43eb636ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a88c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43eb636ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x18c3280 con 0x19f0d10 2024-09-11T14:27:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e379b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a88c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e379b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a88c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46004/0 (socket says 172.21.15.97:46004) 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e379b640 1 -- 172.21.15.97:0/458036664 learned_addr learned my addr 172.21.15.97:0/458036664 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e379b640 1 -- 172.21.15.97:0/458036664 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1853920 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e379b640 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a88c40 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e0f96640 1 -- 172.21.15.97:0/458036664 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43cc0128e0 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e0f96640 1 -- 172.21.15.97:0/458036664 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43cc005040 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1853380 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43e0f96640 1 -- 172.21.15.97:0/458036664 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43cc012b70 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.663+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a86a90 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.664+0000 7f43e0f96640 1 -- 172.21.15.97:0/458036664 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f43cc00d040 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.664+0000 7f43e0f96640 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43c803d1c0 0x7f43c803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.665+0000 7f43e0f96640 1 -- 172.21.15.97:0/458036664 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7f43cc00a040 con 0x19f0d10 2024-09-11T14:27:01.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.665+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/458036664 >> v2:172.21.15.97:6801/2470268139 conn(0x19f1830 0x1a78500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.665+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0x1a7aeb0 con 0x19f1830 2024-09-11T14:27:01.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.665+0000 7f43e2f9a640 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43c803d1c0 0x7f43c803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.666+0000 7f43e3f9c640 1 --2- 172.21.15.97:0/458036664 >> v2:172.21.15.97:6801/2470268139 conn(0x19f1830 0x1a78500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:01.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.666+0000 7f43e2f9a640 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43c803d1c0 0x7f43c803f6d0 crc :-1 s=READY pgs=3775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.669+0000 7f43e3f9c640 1 --2- 172.21.15.97:0/458036664 >> v2:172.21.15.97:6801/2470268139 conn(0x19f1830 0x1a78500 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.683+0000 7f43e3f9c640 1 -- 172.21.15.97:0/458036664 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj3 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f43d400a430 con 0x19f1830 2024-09-11T14:27:01.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.683+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 >> v2:172.21.15.97:6801/2470268139 conn(0x19f1830 msgr2=0x1a78500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.683+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/458036664 >> v2:172.21.15.97:6801/2470268139 conn(0x19f1830 0x1a78500 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43c803d1c0 msgr2=0x7f43c803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43c803d1c0 0x7f43c803f6d0 crc :-1 s=READY pgs=3775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 msgr2=0x1a88c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a88c40 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 shutdown_connections 2024-09-11T14:27:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/458036664 >> v2:172.21.15.97:6801/2470268139 conn(0x19f1830 0x1a78500 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f43c803d1c0 0x7f43c803f6d0 unknown :-1 s=CLOSED pgs=3775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 --2- 172.21.15.97:0/458036664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x19f0d10 0x1a88c40 unknown :-1 s=CLOSED pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 >> 172.21.15.97:0/458036664 conn(0x1885770 msgr2=0x195e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 shutdown_connections 2024-09-11T14:27:01.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.684+0000 7f43eb636ec0 1 -- 172.21.15.97:0/458036664 wait complete. 2024-09-11T14:27:01.688 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.688 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj4 /etc/passwd 2024-09-11T14:27:01.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.722+0000 7ff634a48ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.727+0000 7ff634a48ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.727+0000 7ff634a48ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.728+0000 7ff634a48ec0 1 Processor -- start 2024-09-11T14:27:01.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.728+0000 7ff634a48ec0 1 -- start start 2024-09-11T14:27:01.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff634a48ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x61ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff634a48ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x57f520 con 0x6ad9b0 2024-09-11T14:27:01.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff62cb9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x61ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff62cb9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x61ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46018/0 (socket says 172.21.15.97:46018) 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff62cb9b640 1 -- 172.21.15.97:0/1299935971 learned_addr learned my addr 172.21.15.97:0/1299935971 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff62cb9b640 1 -- 172.21.15.97:0/1299935971 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x51be10 con 0x6ad9b0 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff62cb9b640 1 --2- 172.21.15.97:0/1299935971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x61ead0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3baa569769b928b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff626ffd640 1 -- 172.21.15.97:0/1299935971 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff61802daf0 con 0x6ad9b0 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff626ffd640 1 -- 172.21.15.97:0/1299935971 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff618037370 con 0x6ad9b0 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.729+0000 7ff626ffd640 1 -- 172.21.15.97:0/1299935971 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff6180374e0 con 0x6ad9b0 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.730+0000 7ff634a48ec0 1 -- 172.21.15.97:0/1299935971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 msgr2=0x61ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.730+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/1299935971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x61ead0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.730+0000 7ff634a48ec0 1 -- 172.21.15.97:0/1299935971 shutdown_connections 2024-09-11T14:27:01.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.730+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/1299935971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x61ead0 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.730+0000 7ff634a48ec0 1 -- 172.21.15.97:0/1299935971 >> 172.21.15.97:0/1299935971 conn(0x53f770 msgr2=0x6171d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.730+0000 7ff634a48ec0 1 -- 172.21.15.97:0/1299935971 shutdown_connections 2024-09-11T14:27:01.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.730+0000 7ff634a48ec0 1 -- 172.21.15.97:0/1299935971 wait complete. 2024-09-11T14:27:01.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.731+0000 7ff634a48ec0 1 Processor -- start 2024-09-11T14:27:01.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.731+0000 7ff634a48ec0 1 -- start start 2024-09-11T14:27:01.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff634a48ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x7427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff634a48ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x57d280 con 0x6ad9b0 2024-09-11T14:27:01.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff62cb9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x7427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff62cb9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x7427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46026/0 (socket says 172.21.15.97:46026) 2024-09-11T14:27:01.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff62cb9b640 1 -- 172.21.15.97:0/2958156979 learned_addr learned my addr 172.21.15.97:0/2958156979 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff62cb9b640 1 -- 172.21.15.97:0/2958156979 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x50d920 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff62cb9b640 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x7427d0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff625ffb640 1 -- 172.21.15.97:0/2958156979 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff61803e040 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff625ffb640 1 -- 172.21.15.97:0/2958156979 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff618037eb0 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x50d380 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff625ffb640 1 -- 172.21.15.97:0/2958156979 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff61802daf0 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.732+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x699410 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.733+0000 7ff625ffb640 1 -- 172.21.15.97:0/2958156979 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff618039450 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.734+0000 7ff625ffb640 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff60803d1c0 0x7ff60803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.734+0000 7ff625ffb640 1 -- 172.21.15.97:0/2958156979 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7ff618032040 con 0x6ad9b0 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.734+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/2958156979 >> v2:172.21.15.97:6804/1629092190 conn(0x6ae300 0x6ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.734+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0x69c300 con 0x6ae300 2024-09-11T14:27:01.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.734+0000 7ff61f7fe640 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff60803d1c0 0x7ff60803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.734+0000 7ff61f7fe640 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff60803d1c0 0x7ff60803f6d0 crc :-1 s=READY pgs=3776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.735+0000 7ff62d39c640 1 --2- 172.21.15.97:0/2958156979 >> v2:172.21.15.97:6804/1629092190 conn(0x6ae300 0x6ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:01.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.737+0000 7ff62d39c640 1 --2- 172.21.15.97:0/2958156979 >> v2:172.21.15.97:6804/1629092190 conn(0x6ae300 0x6ac4a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff62d39c640 1 -- 172.21.15.97:0/2958156979 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== osd_op_reply(1 obj4 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff62000a430 con 0x6ae300 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 >> v2:172.21.15.97:6804/1629092190 conn(0x6ae300 msgr2=0x6ac4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/2958156979 >> v2:172.21.15.97:6804/1629092190 conn(0x6ae300 0x6ac4a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff60803d1c0 msgr2=0x7ff60803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff60803d1c0 0x7ff60803f6d0 crc :-1 s=READY pgs=3776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 msgr2=0x7427d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x7427d0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 shutdown_connections 2024-09-11T14:27:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/2958156979 >> v2:172.21.15.97:6804/1629092190 conn(0x6ae300 0x6ac4a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff60803d1c0 0x7ff60803f6d0 unknown :-1 s=CLOSED pgs=3776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 --2- 172.21.15.97:0/2958156979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x6ad9b0 0x7427d0 unknown :-1 s=CLOSED pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 >> 172.21.15.97:0/2958156979 conn(0x53f770 msgr2=0x618da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 shutdown_connections 2024-09-11T14:27:01.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.751+0000 7ff634a48ec0 1 -- 172.21.15.97:0/2958156979 wait complete. 2024-09-11T14:27:01.755 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.755 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj5 /etc/passwd 2024-09-11T14:27:01.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.793+0000 7fa55d6f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.798+0000 7fa55d6f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.798+0000 7fa55d6f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.798+0000 7fa55d6f3ec0 1 Processor -- start 2024-09-11T14:27:01.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.798+0000 7fa55d6f3ec0 1 -- start start 2024-09-11T14:27:01.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.799+0000 7fa55d6f3ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xb289b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.799+0000 7fa55d6f3ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xa89520 con 0xbb79b0 2024-09-11T14:27:01.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.799+0000 7fa555a3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xb289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.799+0000 7fa555a3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xb289b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46032/0 (socket says 172.21.15.97:46032) 2024-09-11T14:27:01.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.799+0000 7fa555a3f640 1 -- 172.21.15.97:0/3436272751 learned_addr learned my addr 172.21.15.97:0/3436272751 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.800+0000 7fa555a3f640 1 -- 172.21.15.97:0/3436272751 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa25e10 con 0xbb79b0 2024-09-11T14:27:01.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.800+0000 7fa555a3f640 1 --2- 172.21.15.97:0/3436272751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xb289b0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc52f96ba5a1cfb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.800+0000 7fa54ffff640 1 -- 172.21.15.97:0/3436272751 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa54000b580 con 0xbb79b0 2024-09-11T14:27:01.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.800+0000 7fa54ffff640 1 -- 172.21.15.97:0/3436272751 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa54000b6e0 con 0xbb79b0 2024-09-11T14:27:01.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.800+0000 7fa54ffff640 1 -- 172.21.15.97:0/3436272751 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa54000b980 con 0xbb79b0 2024-09-11T14:27:01.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/3436272751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 msgr2=0xb289b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/3436272751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xb289b0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/3436272751 shutdown_connections 2024-09-11T14:27:01.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/3436272751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xb289b0 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/3436272751 >> 172.21.15.97:0/3436272751 conn(0xa49770 msgr2=0xb20e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/3436272751 shutdown_connections 2024-09-11T14:27:01.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/3436272751 wait complete. 2024-09-11T14:27:01.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 Processor -- start 2024-09-11T14:27:01.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.801+0000 7fa55d6f3ec0 1 -- start start 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.802+0000 7fa55d6f3ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xc4c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.802+0000 7fa55d6f3ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xa87280 con 0xbb79b0 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa555a3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xc4c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa555a3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xc4c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46034/0 (socket says 172.21.15.97:46034) 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa555a3f640 1 -- 172.21.15.97:0/2414900362 learned_addr learned my addr 172.21.15.97:0/2414900362 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa555a3f640 1 -- 172.21.15.97:0/2414900362 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa17920 con 0xbb79b0 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa555a3f640 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xc4c500 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa54effd640 1 -- 172.21.15.97:0/2414900362 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa540012960 con 0xbb79b0 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa54effd640 1 -- 172.21.15.97:0/2414900362 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa540005040 con 0xbb79b0 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xa17380 con 0xbb79b0 2024-09-11T14:27:01.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa54effd640 1 -- 172.21.15.97:0/2414900362 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa540012bf0 con 0xbb79b0 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.803+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0xba3640 con 0xbb79b0 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.804+0000 7fa54effd640 1 -- 172.21.15.97:0/2414900362 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa54000d040 con 0xbb79b0 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.804+0000 7fa54effd640 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa53c03d1c0 0x7fa53c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.804+0000 7fa54effd640 1 -- 172.21.15.97:0/2414900362 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7fa54000a040 con 0xbb79b0 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.805+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/2414900362 >> v2:172.21.15.117:6808/4196478755 conn(0xbb84d0 0xbb6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.805+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0xba6ae0 con 0xbb84d0 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.805+0000 7fa55523e640 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa53c03d1c0 0x7fa53c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.805+0000 7fa55523e640 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa53c03d1c0 0x7fa53c03f6d0 crc :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.806+0000 7fa556240640 1 --2- 172.21.15.97:0/2414900362 >> v2:172.21.15.117:6808/4196478755 conn(0xbb84d0 0xbb6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:01.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.809+0000 7fa556240640 1 --2- 172.21.15.97:0/2414900362 >> v2:172.21.15.117:6808/4196478755 conn(0xbb84d0 0xbb6600 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.823+0000 7fa556240640 1 -- 172.21.15.97:0/2414900362 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 obj5 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa54800a430 con 0xbb84d0 2024-09-11T14:27:01.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.823+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 >> v2:172.21.15.117:6808/4196478755 conn(0xbb84d0 msgr2=0xbb6600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.823+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/2414900362 >> v2:172.21.15.117:6808/4196478755 conn(0xbb84d0 0xbb6600 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa53c03d1c0 msgr2=0x7fa53c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa53c03d1c0 0x7fa53c03f6d0 crc :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 msgr2=0xc4c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xc4c500 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 shutdown_connections 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/2414900362 >> v2:172.21.15.117:6808/4196478755 conn(0xbb84d0 0xbb6600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa53c03d1c0 0x7fa53c03f6d0 unknown :-1 s=CLOSED pgs=3777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 --2- 172.21.15.97:0/2414900362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbb79b0 0xc4c500 unknown :-1 s=CLOSED pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 >> 172.21.15.97:0/2414900362 conn(0xa49770 msgr2=0xb20930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 shutdown_connections 2024-09-11T14:27:01.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.824+0000 7fa55d6f3ec0 1 -- 172.21.15.97:0/2414900362 wait complete. 2024-09-11T14:27:01.827 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.827 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj6 /etc/passwd 2024-09-11T14:27:01.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.862+0000 7f313b134ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.867+0000 7f313b134ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.867+0000 7f313b134ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.868+0000 7f313b134ec0 1 Processor -- start 2024-09-11T14:27:01.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.868+0000 7f313b134ec0 1 -- start start 2024-09-11T14:27:01.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.869+0000 7f313b134ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1883850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.869+0000 7f313b134ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x176a520 con 0x18989b0 2024-09-11T14:27:01.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.869+0000 7f313343f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1883850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.869+0000 7f313343f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1883850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46054/0 (socket says 172.21.15.97:46054) 2024-09-11T14:27:01.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.869+0000 7f313343f640 1 -- 172.21.15.97:0/409214093 learned_addr learned my addr 172.21.15.97:0/409214093 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.869+0000 7f313343f640 1 -- 172.21.15.97:0/409214093 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1706e10 con 0x18989b0 2024-09-11T14:27:01.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313343f640 1 --2- 172.21.15.97:0/409214093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1883850 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98582c4728525ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f3131c3c640 1 -- 172.21.15.97:0/409214093 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c0061e0 con 0x18989b0 2024-09-11T14:27:01.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f3131c3c640 1 -- 172.21.15.97:0/409214093 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f311c006340 con 0x18989b0 2024-09-11T14:27:01.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f3131c3c640 1 -- 172.21.15.97:0/409214093 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c004880 con 0x18989b0 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313b134ec0 1 -- 172.21.15.97:0/409214093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 msgr2=0x1883850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313b134ec0 1 --2- 172.21.15.97:0/409214093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1883850 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313b134ec0 1 -- 172.21.15.97:0/409214093 shutdown_connections 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313b134ec0 1 --2- 172.21.15.97:0/409214093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1883850 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313b134ec0 1 -- 172.21.15.97:0/409214093 >> 172.21.15.97:0/409214093 conn(0x172a770 msgr2=0x18099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313b134ec0 1 -- 172.21.15.97:0/409214093 shutdown_connections 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.870+0000 7f313b134ec0 1 -- 172.21.15.97:0/409214093 wait complete. 2024-09-11T14:27:01.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.871+0000 7f313b134ec0 1 Processor -- start 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.871+0000 7f313b134ec0 1 -- start start 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.872+0000 7f313b134ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1886d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.872+0000 7f313b134ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1768280 con 0x18989b0 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.872+0000 7f313343f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1886d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.872+0000 7f313343f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1886d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46070/0 (socket says 172.21.15.97:46070) 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.872+0000 7f313343f640 1 -- 172.21.15.97:0/2264266735 learned_addr learned my addr 172.21.15.97:0/2264266735 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.873+0000 7f313343f640 1 -- 172.21.15.97:0/2264266735 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16f8920 con 0x18989b0 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.873+0000 7f313343f640 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1886d50 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.873+0000 7f3130c3a640 1 -- 172.21.15.97:0/2264266735 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c001ad0 con 0x18989b0 2024-09-11T14:27:01.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.873+0000 7f3130c3a640 1 -- 172.21.15.97:0/2264266735 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f311c001c30 con 0x18989b0 2024-09-11T14:27:01.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.873+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x16f8380 con 0x18989b0 2024-09-11T14:27:01.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.873+0000 7f3130c3a640 1 -- 172.21.15.97:0/2264266735 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c001ed0 con 0x18989b0 2024-09-11T14:27:01.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.873+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x188a1e0 con 0x18989b0 2024-09-11T14:27:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.874+0000 7f3130c3a640 1 -- 172.21.15.97:0/2264266735 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f311c013340 con 0x18989b0 2024-09-11T14:27:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.874+0000 7f3130c3a640 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f311803d1c0 0x7f311803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.874+0000 7f3130c3a640 1 -- 172.21.15.97:0/2264266735 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7f311c04f850 con 0x18989b0 2024-09-11T14:27:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.874+0000 7f313b134ec0 1 --2- 172.21.15.97:0/2264266735 >> v2:172.21.15.97:6801/2470268139 conn(0x18994d0 0x1d31a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.874+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0x188a770 con 0x18994d0 2024-09-11T14:27:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.874+0000 7f3132c3e640 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f311803d1c0 0x7f311803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.875+0000 7f3132c3e640 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f311803d1c0 0x7f311803f6d0 crc :-1 s=READY pgs=3778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.875+0000 7f3133c40640 1 --2- 172.21.15.97:0/2264266735 >> v2:172.21.15.97:6801/2470268139 conn(0x18994d0 0x1d31a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:01.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.879+0000 7f3133c40640 1 --2- 172.21.15.97:0/2264266735 >> v2:172.21.15.97:6801/2470268139 conn(0x18994d0 0x1d31a00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f3133c40640 1 -- 172.21.15.97:0/2264266735 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj6 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f312400c430 con 0x18994d0 2024-09-11T14:27:01.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 >> v2:172.21.15.97:6801/2470268139 conn(0x18994d0 msgr2=0x1d31a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 --2- 172.21.15.97:0/2264266735 >> v2:172.21.15.97:6801/2470268139 conn(0x18994d0 0x1d31a00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f311803d1c0 msgr2=0x7f311803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f311803d1c0 0x7f311803f6d0 crc :-1 s=READY pgs=3778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 msgr2=0x1886d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1886d50 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 shutdown_connections 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 --2- 172.21.15.97:0/2264266735 >> v2:172.21.15.97:6801/2470268139 conn(0x18994d0 0x1d31a00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f311803d1c0 0x7f311803f6d0 unknown :-1 s=CLOSED pgs=3778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 --2- 172.21.15.97:0/2264266735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x18989b0 0x1886d50 unknown :-1 s=CLOSED pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.892+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 >> 172.21.15.97:0/2264266735 conn(0x172a770 msgr2=0x1803140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.893+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 shutdown_connections 2024-09-11T14:27:01.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.893+0000 7f313b134ec0 1 -- 172.21.15.97:0/2264266735 wait complete. 2024-09-11T14:27:01.896 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.896 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj7 /etc/passwd 2024-09-11T14:27:01.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.931+0000 7f4d13a36ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.936+0000 7f4d13a36ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.936+0000 7f4d13a36ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:01.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.936+0000 7f4d13a36ec0 1 Processor -- start 2024-09-11T14:27:01.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.936+0000 7f4d13a36ec0 1 -- start start 2024-09-11T14:27:01.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d13a36ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x1569590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d13a36ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x13b5520 con 0x1451300 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x1569590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x1569590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46088/0 (socket says 172.21.15.97:46088) 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d06ffd640 1 -- 172.21.15.97:0/178943631 learned_addr learned my addr 172.21.15.97:0/178943631 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d06ffd640 1 -- 172.21.15.97:0/178943631 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1351e10 con 0x1451300 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d06ffd640 1 --2- 172.21.15.97:0/178943631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x1569590 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2febd42189af88 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d05ffb640 1 -- 172.21.15.97:0/178943631 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cf800a040 con 0x1451300 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d05ffb640 1 -- 172.21.15.97:0/178943631 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4cf800a1a0 con 0x1451300 2024-09-11T14:27:01.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.938+0000 7f4d05ffb640 1 -- 172.21.15.97:0/178943631 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cf8009410 con 0x1451300 2024-09-11T14:27:01.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.939+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/178943631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 msgr2=0x1569590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.939+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/178943631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x1569590 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.939+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/178943631 shutdown_connections 2024-09-11T14:27:01.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.939+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/178943631 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x1569590 unknown :-1 s=CLOSED pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.939+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/178943631 >> 172.21.15.97:0/178943631 conn(0x1375770 msgr2=0x14536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.939+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/178943631 shutdown_connections 2024-09-11T14:27:01.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.939+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/178943631 wait complete. 2024-09-11T14:27:01.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.940+0000 7f4d13a36ec0 1 Processor -- start 2024-09-11T14:27:01.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.940+0000 7f4d13a36ec0 1 -- start start 2024-09-11T14:27:01.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d13a36ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x15784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d13a36ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x13b3280 con 0x1451300 2024-09-11T14:27:01.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x15784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x15784f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46102/0 (socket says 172.21.15.97:46102) 2024-09-11T14:27:01.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d06ffd640 1 -- 172.21.15.97:0/2959296096 learned_addr learned my addr 172.21.15.97:0/2959296096 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:01.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d06ffd640 1 -- 172.21.15.97:0/2959296096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1343920 con 0x1451300 2024-09-11T14:27:01.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d06ffd640 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x15784f0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d04ff9640 1 -- 172.21.15.97:0/2959296096 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cf800a310 con 0x1451300 2024-09-11T14:27:01.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d04ff9640 1 -- 172.21.15.97:0/2959296096 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4cf8009dc0 con 0x1451300 2024-09-11T14:27:01.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1343380 con 0x1451300 2024-09-11T14:27:01.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.941+0000 7f4d04ff9640 1 -- 172.21.15.97:0/2959296096 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cf802dbf0 con 0x1451300 2024-09-11T14:27:01.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.942+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x14e0c00 con 0x1451300 2024-09-11T14:27:01.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.942+0000 7f4d04ff9640 1 -- 172.21.15.97:0/2959296096 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4cf8039450 con 0x1451300 2024-09-11T14:27:01.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.943+0000 7f4d04ff9640 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4ce803d1c0 0x7f4ce803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.943+0000 7f4d04ff9640 1 -- 172.21.15.97:0/2959296096 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7f4cf8040040 con 0x1451300 2024-09-11T14:27:01.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.943+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/2959296096 >> v2:172.21.15.97:6804/1629092190 conn(0x14e3a60 0x14dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:01.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.943+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0x14d01d0 con 0x14e3a60 2024-09-11T14:27:01.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.943+0000 7f4cfffff640 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4ce803d1c0 0x7f4ce803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:01.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.943+0000 7f4cfffff640 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4ce803d1c0 0x7f4ce803f6d0 crc :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.944+0000 7f4d077fe640 1 --2- 172.21.15.97:0/2959296096 >> v2:172.21.15.97:6804/1629092190 conn(0x14e3a60 0x14dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:01.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.947+0000 7f4d077fe640 1 --2- 172.21.15.97:0/2959296096 >> v2:172.21.15.97:6804/1629092190 conn(0x14e3a60 0x14dfb60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:01.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d077fe640 1 -- 172.21.15.97:0/2959296096 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== osd_op_reply(1 obj7 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4d0000a430 con 0x14e3a60 2024-09-11T14:27:01.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 >> v2:172.21.15.97:6804/1629092190 conn(0x14e3a60 msgr2=0x14dfb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/2959296096 >> v2:172.21.15.97:6804/1629092190 conn(0x14e3a60 0x14dfb60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4ce803d1c0 msgr2=0x7f4ce803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4ce803d1c0 0x7f4ce803f6d0 crc :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 msgr2=0x15784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x15784f0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 shutdown_connections 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/2959296096 >> v2:172.21.15.97:6804/1629092190 conn(0x14e3a60 0x14dfb60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4ce803d1c0 0x7f4ce803f6d0 unknown :-1 s=CLOSED pgs=3779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 --2- 172.21.15.97:0/2959296096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1451300 0x15784f0 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.961+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 >> 172.21.15.97:0/2959296096 conn(0x1375770 msgr2=0x14536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:01.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.962+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 shutdown_connections 2024-09-11T14:27:01.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:01.962+0000 7f4d13a36ec0 1 -- 172.21.15.97:0/2959296096 wait complete. 2024-09-11T14:27:01.965 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:01.965 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj8 /etc/passwd 2024-09-11T14:27:02.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.000+0000 7faff5b26ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.005+0000 7faff5b26ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.005+0000 7faff5b26ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.006+0000 7faff5b26ec0 1 Processor -- start 2024-09-11T14:27:02.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.006+0000 7faff5b26ec0 1 -- start start 2024-09-11T14:27:02.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.007+0000 7faff5b26ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa728f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.007+0000 7faff5b26ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x8bc520 con 0x9ea9b0 2024-09-11T14:27:02.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.007+0000 7fafedf9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.007+0000 7fafedf9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa728f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46124/0 (socket says 172.21.15.97:46124) 2024-09-11T14:27:02.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.007+0000 7fafedf9b640 1 -- 172.21.15.97:0/4202083500 learned_addr learned my addr 172.21.15.97:0/4202083500 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:02.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.007+0000 7fafedf9b640 1 -- 172.21.15.97:0/4202083500 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x858e10 con 0x9ea9b0 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.007+0000 7fafedf9b640 1 --2- 172.21.15.97:0/4202083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa728f0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde9f846bfb13b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7fafe77fe640 1 -- 172.21.15.97:0/4202083500 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafd800b500 con 0x9ea9b0 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7fafe77fe640 1 -- 172.21.15.97:0/4202083500 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fafd800b660 con 0x9ea9b0 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7fafe77fe640 1 -- 172.21.15.97:0/4202083500 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafd800b900 con 0x9ea9b0 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7faff5b26ec0 1 -- 172.21.15.97:0/4202083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 msgr2=0xa728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/4202083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa728f0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7faff5b26ec0 1 -- 172.21.15.97:0/4202083500 shutdown_connections 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/4202083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa728f0 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7faff5b26ec0 1 -- 172.21.15.97:0/4202083500 >> 172.21.15.97:0/4202083500 conn(0x87c770 msgr2=0x9552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:02.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7faff5b26ec0 1 -- 172.21.15.97:0/4202083500 shutdown_connections 2024-09-11T14:27:02.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.008+0000 7faff5b26ec0 1 -- 172.21.15.97:0/4202083500 wait complete. 2024-09-11T14:27:02.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.009+0000 7faff5b26ec0 1 Processor -- start 2024-09-11T14:27:02.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.009+0000 7faff5b26ec0 1 -- start start 2024-09-11T14:27:02.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.010+0000 7faff5b26ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa7f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.010+0000 7faff5b26ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x8ba280 con 0x9ea9b0 2024-09-11T14:27:02.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.010+0000 7fafedf9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa7f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.010+0000 7fafedf9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa7f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46140/0 (socket says 172.21.15.97:46140) 2024-09-11T14:27:02.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.010+0000 7fafedf9b640 1 -- 172.21.15.97:0/1805323018 learned_addr learned my addr 172.21.15.97:0/1805323018 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:02.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.010+0000 7fafedf9b640 1 -- 172.21.15.97:0/1805323018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x84a920 con 0x9ea9b0 2024-09-11T14:27:02.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.011+0000 7fafedf9b640 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa7f880 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.011+0000 7fafe67fc640 1 -- 172.21.15.97:0/1805323018 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafd80111e0 con 0x9ea9b0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.011+0000 7fafe67fc640 1 -- 172.21.15.97:0/1805323018 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fafd8011880 con 0x9ea9b0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.011+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x84a380 con 0x9ea9b0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.011+0000 7fafe67fc640 1 -- 172.21.15.97:0/1805323018 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafd80119f0 con 0x9ea9b0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.011+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x9ea520 con 0x9ea9b0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.012+0000 7fafe67fc640 1 -- 172.21.15.97:0/1805323018 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fafd8011ba0 con 0x9ea9b0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.012+0000 7fafe67fc640 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fafd403d1c0 0x7fafd403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.012+0000 7fafe67fc640 1 -- 172.21.15.97:0/1805323018 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7fafd8050130 con 0x9ea9b0 2024-09-11T14:27:02.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.012+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/1805323018 >> v2:172.21.15.117:6811/2173725438 conn(0x9eb4d0 0x9e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.012+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 --> v2:172.21.15.117:6811/2173725438 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0x9d9af0 con 0x9eb4d0 2024-09-11T14:27:02.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.012+0000 7fafed79a640 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fafd403d1c0 0x7fafd403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.013+0000 7fafed79a640 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fafd403d1c0 0x7fafd403f6d0 crc :-1 s=READY pgs=3780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.013+0000 7fafee79c640 1 --2- 172.21.15.97:0/1805323018 >> v2:172.21.15.117:6811/2173725438 conn(0x9eb4d0 0x9e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:02.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.016+0000 7fafee79c640 1 --2- 172.21.15.97:0/1805323018 >> v2:172.21.15.117:6811/2173725438 conn(0x9eb4d0 0x9e9460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7fafee79c640 1 -- 172.21.15.97:0/1805323018 <== osd.2 v2:172.21.15.117:6811/2173725438 1 ==== osd_op_reply(1 obj8 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fafe000a430 con 0x9eb4d0 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 >> v2:172.21.15.117:6811/2173725438 conn(0x9eb4d0 msgr2=0x9e9460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/1805323018 >> v2:172.21.15.117:6811/2173725438 conn(0x9eb4d0 0x9e9460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fafd403d1c0 msgr2=0x7fafd403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fafd403d1c0 0x7fafd403f6d0 crc :-1 s=READY pgs=3780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 msgr2=0xa7f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa7f880 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 shutdown_connections 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/1805323018 >> v2:172.21.15.117:6811/2173725438 conn(0x9eb4d0 0x9e9460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fafd403d1c0 0x7fafd403f6d0 unknown :-1 s=CLOSED pgs=3780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 --2- 172.21.15.97:0/1805323018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x9ea9b0 0xa7f880 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 >> 172.21.15.97:0/1805323018 conn(0x87c770 msgr2=0x9552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:02.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 shutdown_connections 2024-09-11T14:27:02.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.032+0000 7faff5b26ec0 1 -- 172.21.15.97:0/1805323018 wait complete. 2024-09-11T14:27:02.035 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:02.035 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj9 /etc/passwd 2024-09-11T14:27:02.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.070+0000 7feb3222dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.075+0000 7feb3222dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.075+0000 7feb3222dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.076+0000 7feb3222dec0 1 Processor -- start 2024-09-11T14:27:02.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.076+0000 7feb3222dec0 1 -- start start 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb3222dec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfdb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb3222dec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xe25520 con 0xf539b0 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb2a39b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfdb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb2a39b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfdb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46158/0 (socket says 172.21.15.97:46158) 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb2a39b640 1 -- 172.21.15.97:0/3672339287 learned_addr learned my addr 172.21.15.97:0/3672339287 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb2a39b640 1 -- 172.21.15.97:0/3672339287 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdc1e10 con 0xf539b0 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb2a39b640 1 --2- 172.21.15.97:0/3672339287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfdb8f0 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93925cd78dd37fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb28b98640 1 -- 172.21.15.97:0/3672339287 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb1400b500 con 0xf539b0 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb28b98640 1 -- 172.21.15.97:0/3672339287 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb1400b660 con 0xf539b0 2024-09-11T14:27:02.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.077+0000 7feb28b98640 1 -- 172.21.15.97:0/3672339287 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb1400b900 con 0xf539b0 2024-09-11T14:27:02.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.078+0000 7feb3222dec0 1 -- 172.21.15.97:0/3672339287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 msgr2=0xfdb8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.078+0000 7feb3222dec0 1 --2- 172.21.15.97:0/3672339287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfdb8f0 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.078+0000 7feb3222dec0 1 -- 172.21.15.97:0/3672339287 shutdown_connections 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.078+0000 7feb3222dec0 1 --2- 172.21.15.97:0/3672339287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfdb8f0 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.078+0000 7feb3222dec0 1 -- 172.21.15.97:0/3672339287 >> 172.21.15.97:0/3672339287 conn(0xde5770 msgr2=0xebe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.078+0000 7feb3222dec0 1 -- 172.21.15.97:0/3672339287 shutdown_connections 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.078+0000 7feb3222dec0 1 -- 172.21.15.97:0/3672339287 wait complete. 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.079+0000 7feb3222dec0 1 Processor -- start 2024-09-11T14:27:02.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.079+0000 7feb3222dec0 1 -- start start 2024-09-11T14:27:02.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb3222dec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfe8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb3222dec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xe23280 con 0xf539b0 2024-09-11T14:27:02.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb2a39b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfe8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb2a39b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfe8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46170/0 (socket says 172.21.15.97:46170) 2024-09-11T14:27:02.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb2a39b640 1 -- 172.21.15.97:0/4024118810 learned_addr learned my addr 172.21.15.97:0/4024118810 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:02.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb2a39b640 1 -- 172.21.15.97:0/4024118810 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdb3920 con 0xf539b0 2024-09-11T14:27:02.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb2a39b640 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfe8880 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.080+0000 7feb22ffd640 1 -- 172.21.15.97:0/4024118810 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb140111e0 con 0xf539b0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.081+0000 7feb22ffd640 1 -- 172.21.15.97:0/4024118810 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb14011880 con 0xf539b0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.081+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xdb3380 con 0xf539b0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.081+0000 7feb22ffd640 1 -- 172.21.15.97:0/4024118810 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb140119f0 con 0xf539b0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.081+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf53520 con 0xf539b0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.081+0000 7feb22ffd640 1 -- 172.21.15.97:0/4024118810 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feb14011ba0 con 0xf539b0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.082+0000 7feb22ffd640 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7feb1003d1c0 0x7feb1003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.082+0000 7feb22ffd640 1 -- 172.21.15.97:0/4024118810 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7feb14050130 con 0xf539b0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.082+0000 7feb3222dec0 1 --2- 172.21.15.97:0/4024118810 >> v2:172.21.15.97:6801/2470268139 conn(0xf544d0 0xf52460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.082+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0xf42af0 con 0xf544d0 2024-09-11T14:27:02.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.082+0000 7feb29b9a640 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7feb1003d1c0 0x7feb1003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.083+0000 7feb29b9a640 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7feb1003d1c0 0x7feb1003f6d0 crc :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.083+0000 7feb2ab9c640 1 --2- 172.21.15.97:0/4024118810 >> v2:172.21.15.97:6801/2470268139 conn(0xf544d0 0xf52460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:02.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.085+0000 7feb2ab9c640 1 --2- 172.21.15.97:0/4024118810 >> v2:172.21.15.97:6801/2470268139 conn(0xf544d0 0xf52460 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.099+0000 7feb2ab9c640 1 -- 172.21.15.97:0/4024118810 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj9 [writefull 0~12777] v694'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb1c00a430 con 0xf544d0 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 >> v2:172.21.15.97:6801/2470268139 conn(0xf544d0 msgr2=0xf52460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 --2- 172.21.15.97:0/4024118810 >> v2:172.21.15.97:6801/2470268139 conn(0xf544d0 0xf52460 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7feb1003d1c0 msgr2=0x7feb1003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7feb1003d1c0 0x7feb1003f6d0 crc :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 msgr2=0xfe8880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfe8880 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 shutdown_connections 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 --2- 172.21.15.97:0/4024118810 >> v2:172.21.15.97:6801/2470268139 conn(0xf544d0 0xf52460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7feb1003d1c0 0x7feb1003f6d0 unknown :-1 s=CLOSED pgs=3781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 --2- 172.21.15.97:0/4024118810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xf539b0 0xfe8880 unknown :-1 s=CLOSED pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 >> 172.21.15.97:0/4024118810 conn(0xde5770 msgr2=0xebe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:02.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 shutdown_connections 2024-09-11T14:27:02.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.100+0000 7feb3222dec0 1 -- 172.21.15.97:0/4024118810 wait complete. 2024-09-11T14:27:02.105 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:27:02.105 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put obj10 /etc/passwd 2024-09-11T14:27:02.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.139+0000 7f4f9ac34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.144+0000 7f4f9ac34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.144+0000 7f4f9ac34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:02.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.144+0000 7f4f9ac34ec0 1 Processor -- start 2024-09-11T14:27:02.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.144+0000 7f4f9ac34ec0 1 -- start start 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.145+0000 7f4f9ac34ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x1a58590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.145+0000 7f4f9ac34ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x18a4520 con 0x1940300 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.145+0000 7f4f92c3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x1a58590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.146+0000 7f4f92c3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x1a58590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46198/0 (socket says 172.21.15.97:46198) 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.146+0000 7f4f92c3f640 1 -- 172.21.15.97:0/2387163070 learned_addr learned my addr 172.21.15.97:0/2387163070 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.146+0000 7f4f92c3f640 1 -- 172.21.15.97:0/2387163070 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1840e10 con 0x1940300 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.146+0000 7f4f92c3f640 1 --2- 172.21.15.97:0/2387163070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x1a58590 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36fa0c29d8b58ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.146+0000 7f4f9143c640 1 -- 172.21.15.97:0/2387163070 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f7c02dc20 con 0x1940300 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.146+0000 7f4f9143c640 1 -- 172.21.15.97:0/2387163070 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f7c037370 con 0x1940300 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.146+0000 7f4f9143c640 1 -- 172.21.15.97:0/2387163070 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f7c037610 con 0x1940300 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2387163070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 msgr2=0x1a58590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2387163070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x1a58590 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2387163070 shutdown_connections 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2387163070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x1a58590 unknown :-1 s=CLOSED pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2387163070 >> 172.21.15.97:0/2387163070 conn(0x1864770 msgr2=0x19426f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2387163070 shutdown_connections 2024-09-11T14:27:02.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2387163070 wait complete. 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.147+0000 7f4f9ac34ec0 1 Processor -- start 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.148+0000 7f4f9ac34ec0 1 -- start start 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.148+0000 7f4f9ac34ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x19ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f9ac34ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x18a2280 con 0x1940300 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f92c3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x19ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f92c3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x19ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46212/0 (socket says 172.21.15.97:46212) 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f92c3f640 1 -- 172.21.15.97:0/2899526852 learned_addr learned my addr 172.21.15.97:0/2899526852 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f92c3f640 1 -- 172.21.15.97:0/2899526852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1832920 con 0x1940300 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f92c3f640 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x19ceb80 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f8bfff640 1 -- 172.21.15.97:0/2899526852 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f7c03e040 con 0x1940300 2024-09-11T14:27:02.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f8bfff640 1 -- 172.21.15.97:0/2899526852 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f7c02daf0 con 0x1940300 2024-09-11T14:27:02.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1832380 con 0x1940300 2024-09-11T14:27:02.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f8bfff640 1 -- 172.21.15.97:0/2899526852 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f7c037e20 con 0x1940300 2024-09-11T14:27:02.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.149+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x19bf660 con 0x1940300 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.150+0000 7f4f8bfff640 1 -- 172.21.15.97:0/2899526852 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4f7c041040 con 0x1940300 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.150+0000 7f4f8bfff640 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4f7803d1c0 0x7f4f7803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.150+0000 7f4f8bfff640 1 -- 172.21.15.97:0/2899526852 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(694..694 src has 397..694) ==== 3819+0+0 (crc 0 0 0) 0x7f4f7c032040 con 0x1940300 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.151+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2899526852 >> v2:172.21.15.97:6801/2470268139 conn(0x19d2a60 0x19bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.151+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e694) -- 0x19be9f0 con 0x19d2a60 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.151+0000 7f4f9243e640 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4f7803d1c0 0x7f4f7803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.151+0000 7f4f9243e640 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4f7803d1c0 0x7f4f7803f6d0 crc :-1 s=READY pgs=3782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.152+0000 7f4f93440640 1 --2- 172.21.15.97:0/2899526852 >> v2:172.21.15.97:6801/2470268139 conn(0x19d2a60 0x19bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:02.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.155+0000 7f4f93440640 1 --2- 172.21.15.97:0/2899526852 >> v2:172.21.15.97:6801/2470268139 conn(0x19d2a60 0x19bbf90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:02.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.168+0000 7f4f93440640 1 -- 172.21.15.97:0/2899526852 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj10 [writefull 0~12777] v694'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4f8400a430 con 0x19d2a60 2024-09-11T14:27:02.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 >> v2:172.21.15.97:6801/2470268139 conn(0x19d2a60 msgr2=0x19bbf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2899526852 >> v2:172.21.15.97:6801/2470268139 conn(0x19d2a60 0x19bbf90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4f7803d1c0 msgr2=0x7f4f7803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4f7803d1c0 0x7f4f7803f6d0 crc :-1 s=READY pgs=3782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 msgr2=0x19ceb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x19ceb80 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 shutdown_connections 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2899526852 >> v2:172.21.15.97:6801/2470268139 conn(0x19d2a60 0x19bbf90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f4f7803d1c0 0x7f4f7803f6d0 unknown :-1 s=CLOSED pgs=3782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 --2- 172.21.15.97:0/2899526852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1940300 0x19ceb80 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 >> 172.21.15.97:0/2899526852 conn(0x1864770 msgr2=0x1a58590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 shutdown_connections 2024-09-11T14:27:02.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:02.169+0000 7f4f9ac34ec0 1 -- 172.21.15.97:0/2899526852 wait complete. 2024-09-11T14:27:02.172 INFO:tasks.workunit.client.0.smithi097.stderr:+ sleep 30 2024-09-11T14:27:32.175 INFO:tasks.workunit.client.0.smithi097.stderr:+ pid=96219 2024-09-11T14:27:32.175 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota f2397458-472b-40b3-b6c8-73884edb56f3 max_objects 100 2024-09-11T14:27:32.175 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put onemore /etc/passwd 2024-09-11T14:27:32.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.216+0000 7f21864e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:32.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.223+0000 7f21864e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:32.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.223+0000 7f21864e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:32.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.223+0000 7f21864e7ec0 1 Processor -- start 2024-09-11T14:27:32.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.223+0000 7f21864e7ec0 1 -- start start 2024-09-11T14:27:32.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.224+0000 7f21864e7ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e47f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:32.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.224+0000 7f21864e7ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1c8f520 con 0x1d22fc0 2024-09-11T14:27:32.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.225+0000 7f217e83f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e47f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:32.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.225+0000 7f217e83f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e47f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46280/0 (socket says 172.21.15.97:46280) 2024-09-11T14:27:32.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.225+0000 7f217e83f640 1 -- 172.21.15.97:0/3883332321 learned_addr learned my addr 172.21.15.97:0/3883332321 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:32.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.225+0000 7f217e83f640 1 -- 172.21.15.97:0/3883332321 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c2be10 con 0x1d22fc0 2024-09-11T14:27:32.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.225+0000 7f217e83f640 1 --2- 172.21.15.97:0/3883332321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e47f00 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbf43fb1916dd8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:32.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.225+0000 7f217d03c640 1 -- 172.21.15.97:0/3883332321 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f216c02dcc0 con 0x1d22fc0 2024-09-11T14:27:32.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.225+0000 7f217d03c640 1 -- 172.21.15.97:0/3883332321 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f216c037370 con 0x1d22fc0 2024-09-11T14:27:32.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.226+0000 7f217d03c640 1 -- 172.21.15.97:0/3883332321 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f216c037610 con 0x1d22fc0 2024-09-11T14:27:32.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.226+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3883332321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 msgr2=0x1e47f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:32.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.226+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3883332321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e47f00 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:32.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.227+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3883332321 shutdown_connections 2024-09-11T14:27:32.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.227+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3883332321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e47f00 unknown :-1 s=CLOSED pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:32.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.227+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3883332321 >> 172.21.15.97:0/3883332321 conn(0x1c4f770 msgr2=0x1d24700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:32.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.227+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3883332321 shutdown_connections 2024-09-11T14:27:32.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.227+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3883332321 wait complete. 2024-09-11T14:27:32.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.227+0000 7f21864e7ec0 1 Processor -- start 2024-09-11T14:27:32.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.228+0000 7f21864e7ec0 1 -- start start 2024-09-11T14:27:32.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.229+0000 7f21864e7ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e52950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:32.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.229+0000 7f21864e7ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1c8d280 con 0x1d22fc0 2024-09-11T14:27:32.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.229+0000 7f217e83f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e52950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:32.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.229+0000 7f217e83f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e52950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46282/0 (socket says 172.21.15.97:46282) 2024-09-11T14:27:32.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.229+0000 7f217e83f640 1 -- 172.21.15.97:0/3290647887 learned_addr learned my addr 172.21.15.97:0/3290647887 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:32.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.229+0000 7f217e83f640 1 -- 172.21.15.97:0/3290647887 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c1d920 con 0x1d22fc0 2024-09-11T14:27:32.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.229+0000 7f217e83f640 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e52950 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:32.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.230+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f216c0374e0 con 0x1d22fc0 2024-09-11T14:27:32.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.230+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f216c02db90 con 0x1d22fc0 2024-09-11T14:27:32.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.230+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f216c02dd00 con 0x1d22fc0 2024-09-11T14:27:32.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.230+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c1d380 con 0x1d22fc0 2024-09-11T14:27:32.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.230+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e4b580 con 0x1d22fc0 2024-09-11T14:27:32.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.231+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f216c039450 con 0x1d22fc0 2024-09-11T14:27:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.231+0000 7f21777fe640 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f216403d1c0 0x7f216403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.231+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(695..695 src has 397..695) ==== 3819+0+0 (crc 0 0 0) 0x7f216c032040 con 0x1d22fc0 2024-09-11T14:27:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.231+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=696}) -- 0x7f21640434b0 con 0x1d22fc0 2024-09-11T14:27:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.231+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3290647887 >> v2:172.21.15.117:6811/2173725438 conn(0x1d2b130 0x1e2f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.231+0000 7f217e03e640 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f216403d1c0 0x7f216403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.232+0000 7f217e03e640 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f216403d1c0 0x7f216403f6d0 crc :-1 s=READY pgs=3783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:32.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.233+0000 7f217f040640 1 --2- 172.21.15.97:0/3290647887 >> v2:172.21.15.117:6811/2173725438 conn(0x1d2b130 0x1e2f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:32.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.237+0000 7f217f040640 1 --2- 172.21.15.97:0/3290647887 >> v2:172.21.15.117:6811/2173725438 conn(0x1d2b130 0x1e2f770 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.267+0000 7f216d2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.277+0000 7f216d2bd640 1 Processor -- start 2024-09-11T14:27:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.277+0000 7f216d2bd640 1 -- start start 2024-09-11T14:27:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.278+0000 7f216d2bd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f216809ed30 0x7f21681362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f216d2bd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216809fd50 con 0x7f2168136800 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f216d2bd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f216809fa40 con 0x7f216809ed30 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2166ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f216809ed30 0x7f21681362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2166ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f216809ed30 0x7f21681362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46290/0 (socket says 172.21.15.97:46290) 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2166ffd640 1 -- 172.21.15.97:0/3353536001 learned_addr learned my addr 172.21.15.97:0/3353536001 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2166ffd640 1 -- 172.21.15.97:0/3353536001 >> v1:172.21.15.97:6789/0 conn(0x7f2168136800 legacy=0x7f216806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2166ffd640 1 -- 172.21.15.97:0/3353536001 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216809ffe0 con 0x7f216809ed30 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2165ffb640 1 -- 172.21.15.97:0/3353536001 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728872993 0 0) 0x7f216809fd50 con 0x7f2168136800 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2166ffd640 1 --2- 172.21.15.97:0/3353536001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f21681362c0 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e3cb1126c41398 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2165ffb640 1 -- 172.21.15.97:0/3353536001 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2150009e50 con 0x7f216809ed30 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2165ffb640 1 -- 172.21.15.97:0/3353536001 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f215000e230 con 0x7f216809ed30 2024-09-11T14:27:32.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.279+0000 7f2165ffb640 1 -- 172.21.15.97:0/3353536001 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f215000e4d0 con 0x7f216809ed30 2024-09-11T14:27:32.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 1 -- 172.21.15.97:0/3353536001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 msgr2=0x7f21681362c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:32.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 1 --2- 172.21.15.97:0/3353536001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f21681362c0 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:32.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 1 -- 172.21.15.97:0/3353536001 shutdown_connections 2024-09-11T14:27:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 1 --2- 172.21.15.97:0/3353536001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f21681362c0 unknown :-1 s=CLOSED pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 1 -- 172.21.15.97:0/3353536001 >> 172.21.15.97:0/3353536001 conn(0x7f21680a5350 msgr2=0x7f21680a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 1 -- 172.21.15.97:0/3353536001 shutdown_connections 2024-09-11T14:27:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 1 -- 172.21.15.97:0/3353536001 wait complete. 2024-09-11T14:27:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.280+0000 7f216d2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.282+0000 7f216d2bd640 1 Processor -- start 2024-09-11T14:27:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.282+0000 7f216d2bd640 1 -- start start 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f216d2bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f2168120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f216d2bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2168122db0 con 0x7f216809ed30 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f2166ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f2168120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f2166ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f2168120ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46306/0 (socket says 172.21.15.97:46306) 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f2166ffd640 1 -- 172.21.15.97:0/2660755904 learned_addr learned my addr 172.21.15.97:0/2660755904 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f2166ffd640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2168124ad0 con 0x7f216809ed30 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f2166ffd640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f2168120ac0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.283+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f215000ee50 con 0x7f216809ed30 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.284+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2150015420 con 0x7f216809ed30 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.284+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2168121e70 con 0x7f216809ed30 2024-09-11T14:27:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.284+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21500156c0 con 0x7f216809ed30 2024-09-11T14:27:32.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.284+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2168122500 con 0x7f216809ed30 2024-09-11T14:27:32.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.285+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2168134da0 con 0x7f216809ed30 2024-09-11T14:27:32.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.285+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2150015870 con 0x7f216809ed30 2024-09-11T14:27:32.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.285+0000 7f215f7fe640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f214803e930 0x7f2148040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.285+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(695..695 src has 397..695) ==== 3819+0+0 (crc 0 0 0) 0x7f2150051190 con 0x7f216809ed30 2024-09-11T14:27:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.285+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=696}) -- 0x7f2148044bc0 con 0x7f216809ed30 2024-09-11T14:27:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.286+0000 7f21667fc640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f214803e930 0x7f2148040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.286+0000 7f21667fc640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f214803e930 0x7f2148040e40 crc :-1 s=READY pgs=3784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:32.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.290+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2150014c60 con 0x7f216809ed30 2024-09-11T14:27:32.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:32.470+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "100"} v 0) -- 0x7f21681362c0 con 0x7f216809ed30 2024-09-11T14:27:33.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:33.420+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v696) ==== 225+0+0 (crc 0 0 0) 0x7f21500129e0 con 0x7f216809ed30 2024-09-11T14:27:33.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:33.420+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 6 ==== osd_map(696..696 src has 397..696) ==== 628+0+0 (crc 0 0 0) 0x7f216c033210 con 0x1d22fc0 2024-09-11T14:27:33.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:33.420+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(696..696 src has 397..696) ==== 628+0+0 (crc 0 0 0) 0x7f2150012d80 con 0x7f216809ed30 2024-09-11T14:27:33.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:33.420+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7f2148045b00 con 0x7f216809ed30 2024-09-11T14:27:33.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:33.420+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7f2164043bf0 con 0x1d22fc0 2024-09-11T14:27:33.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:33.548+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "100"} v 0) -- 0x7f2168076080 con 0x7f216809ed30 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.441+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v697) ==== 225+0+0 (crc 0 0 0) 0x7f2150012bc0 con 0x7f216809ed30 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_objects = 100 for pool f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 <== mon.0 v2:172.21.15.97:3300/0 10 ==== osd_map(697..697 src has 397..697) ==== 628+0+0 (crc 0 0 0) 0x7f2150011e00 con 0x7f216809ed30 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 7 ==== osd_map(697..697 src has 397..697) ==== 628+0+0 (crc 0 0 0) 0x7f216c034460 con 0x1d22fc0 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f215f7fe640 1 -- 172.21.15.97:0/2660755904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7f2148045bb0 con 0x7f216809ed30 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7f2164043bf0 con 0x1d22fc0 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f214803e930 msgr2=0x7f2148040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f214803e930 0x7f2148040e40 crc :-1 s=READY pgs=3784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:34.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 msgr2=0x7f2168120ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f2168120ac0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 shutdown_connections 2024-09-11T14:27:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f214803e930 0x7f2148040e40 unknown :-1 s=CLOSED pgs=3784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 --2- 172.21.15.97:0/2660755904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f216809ed30 0x7f2168120ac0 unknown :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 >> 172.21.15.97:0/2660755904 conn(0x7f21680a5350 msgr2=0x7f21681bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 shutdown_connections 2024-09-11T14:27:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:34.444+0000 7f216d2bd640 1 -- 172.21.15.97:0/2660755904 wait complete. 2024-09-11T14:27:34.460 INFO:tasks.workunit.client.0.smithi097.stderr:+ wait 96219 2024-09-11T14:27:37.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:37.231+0000 7f21802a2640 1 -- 172.21.15.97:0/3290647887 --> v2:172.21.15.117:6811/2173725438 -- ping magic: 0 -- 0x7f2150000b90 con 0x1d2b130 2024-09-11T14:27:38.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.422+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(698..698 src has 397..698) ==== 628+0+0 (crc 0 0 0) 0x7f216c006d10 con 0x1d22fc0 2024-09-11T14:27:38.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.422+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7f2164043bf0 con 0x1d22fc0 2024-09-11T14:27:38.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.422+0000 7f21777fe640 1 -- 172.21.15.97:0/3290647887 --> v2:172.21.15.117:6811/2173725438 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x7f2164043f00 con 0x1d2b130 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f217f040640 1 -- 172.21.15.97:0/3290647887 <== osd.2 v2:172.21.15.117:6811/2173725438 1 ==== osd_op_reply(1 onemore [writefull 0~12777] v698'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f217000a430 con 0x1d2b130 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 >> v2:172.21.15.117:6811/2173725438 conn(0x1d2b130 msgr2=0x1e2f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3290647887 >> v2:172.21.15.117:6811/2173725438 conn(0x1d2b130 0x1e2f770 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f216403d1c0 msgr2=0x7f216403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f216403d1c0 0x7f216403f6d0 crc :-1 s=READY pgs=3783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 msgr2=0x1e52950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e52950 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 shutdown_connections 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3290647887 >> v2:172.21.15.117:6811/2173725438 conn(0x1d2b130 0x1e2f770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f216403d1c0 0x7f216403f6d0 unknown :-1 s=CLOSED pgs=3783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 --2- 172.21.15.97:0/3290647887 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1d22fc0 0x1e52950 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 >> 172.21.15.97:0/3290647887 conn(0x1c4f770 msgr2=0x1d24660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 shutdown_connections 2024-09-11T14:27:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.469+0000 7f21864e7ec0 1 -- 172.21.15.97:0/3290647887 wait complete. 2024-09-11T14:27:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T14:27:38.473 INFO:tasks.workunit.client.0.smithi097.stderr:+ true 2024-09-11T14:27:38.474 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put twomore /etc/passwd 2024-09-11T14:27:38.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.510+0000 7ff879b28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:38.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.516+0000 7ff879b28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:38.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.516+0000 7ff879b28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:38.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.518+0000 7ff879b28ec0 1 Processor -- start 2024-09-11T14:27:38.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.518+0000 7ff879b28ec0 1 -- start start 2024-09-11T14:27:38.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.519+0000 7ff879b28ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x1f52d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.519+0000 7ff879b28ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1ed1520 con 0x1f64fc0 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff871f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x1f52d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff871f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x1f52d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46318/0 (socket says 172.21.15.97:46318) 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff871f9b640 1 -- 172.21.15.97:0/1269288591 learned_addr learned my addr 172.21.15.97:0/1269288591 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff871f9b640 1 -- 172.21.15.97:0/1269288591 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e6de10 con 0x1f64fc0 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff871f9b640 1 --2- 172.21.15.97:0/1269288591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x1f52d80 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b81389fb354ac87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff86b7fe640 1 -- 172.21.15.97:0/1269288591 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff86400c5e0 con 0x1f64fc0 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff86b7fe640 1 -- 172.21.15.97:0/1269288591 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff86400c740 con 0x1f64fc0 2024-09-11T14:27:38.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.520+0000 7ff86b7fe640 1 -- 172.21.15.97:0/1269288591 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff86400c9e0 con 0x1f64fc0 2024-09-11T14:27:38.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.521+0000 7ff879b28ec0 1 -- 172.21.15.97:0/1269288591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 msgr2=0x1f52d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.521+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/1269288591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x1f52d80 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.521+0000 7ff879b28ec0 1 -- 172.21.15.97:0/1269288591 shutdown_connections 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.521+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/1269288591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x1f52d80 unknown :-1 s=CLOSED pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.521+0000 7ff879b28ec0 1 -- 172.21.15.97:0/1269288591 >> 172.21.15.97:0/1269288591 conn(0x1e91770 msgr2=0x1f66700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.521+0000 7ff879b28ec0 1 -- 172.21.15.97:0/1269288591 shutdown_connections 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.521+0000 7ff879b28ec0 1 -- 172.21.15.97:0/1269288591 wait complete. 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.522+0000 7ff879b28ec0 1 Processor -- start 2024-09-11T14:27:38.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.522+0000 7ff879b28ec0 1 -- start start 2024-09-11T14:27:38.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.523+0000 7ff879b28ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x2077280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.523+0000 7ff879b28ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1ecf280 con 0x1f64fc0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff871f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x2077280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff871f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x2077280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46332/0 (socket says 172.21.15.97:46332) 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff871f9b640 1 -- 172.21.15.97:0/3160661060 learned_addr learned my addr 172.21.15.97:0/3160661060 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff871f9b640 1 -- 172.21.15.97:0/3160661060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e5f920 con 0x1f64fc0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff871f9b640 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x2077280 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff86a7fc640 1 -- 172.21.15.97:0/3160661060 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff8640139c0 con 0x1f64fc0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff86a7fc640 1 -- 172.21.15.97:0/3160661060 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff864013b20 con 0x1f64fc0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e5f380 con 0x1f64fc0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff86a7fc640 1 -- 172.21.15.97:0/3160661060 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff864013dc0 con 0x1f64fc0 2024-09-11T14:27:38.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.524+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2087920 con 0x1f64fc0 2024-09-11T14:27:38.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.525+0000 7ff86a7fc640 1 -- 172.21.15.97:0/3160661060 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff864010400 con 0x1f64fc0 2024-09-11T14:27:38.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.525+0000 7ff86a7fc640 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff84c03d1c0 0x7ff84c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:38.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.525+0000 7ff86a7fc640 1 -- 172.21.15.97:0/3160661060 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(698..698 src has 397..698) ==== 3819+0+0 (crc 0 0 0) 0x7ff864008040 con 0x1f64fc0 2024-09-11T14:27:38.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.526+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/3160661060 >> v2:172.21.15.117:6808/4196478755 conn(0x1f6d300 0x2094700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:38.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.526+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x2094c40 con 0x1f6d300 2024-09-11T14:27:38.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.526+0000 7ff87179a640 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff84c03d1c0 0x7ff84c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:38.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.526+0000 7ff87179a640 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff84c03d1c0 0x7ff84c03f6d0 crc :-1 s=READY pgs=3785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:38.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.526+0000 7ff87279c640 1 --2- 172.21.15.97:0/3160661060 >> v2:172.21.15.117:6808/4196478755 conn(0x1f6d300 0x2094700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:27:38.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.529+0000 7ff87279c640 1 --2- 172.21.15.97:0/3160661060 >> v2:172.21.15.117:6808/4196478755 conn(0x1f6d300 0x2094700 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff87279c640 1 -- 172.21.15.97:0/3160661060 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 twomore [writefull 0~12777] v698'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7ff85c00a430 con 0x1f6d300 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 >> v2:172.21.15.117:6808/4196478755 conn(0x1f6d300 msgr2=0x2094700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/3160661060 >> v2:172.21.15.117:6808/4196478755 conn(0x1f6d300 0x2094700 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff84c03d1c0 msgr2=0x7ff84c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff84c03d1c0 0x7ff84c03f6d0 crc :-1 s=READY pgs=3785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 msgr2=0x2077280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x2077280 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 shutdown_connections 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/3160661060 >> v2:172.21.15.117:6808/4196478755 conn(0x1f6d300 0x2094700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ff84c03d1c0 0x7ff84c03f6d0 unknown :-1 s=CLOSED pgs=3785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 --2- 172.21.15.97:0/3160661060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1f64fc0 0x2077280 unknown :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 >> 172.21.15.97:0/3160661060 conn(0x1e91770 msgr2=0x1f70f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 shutdown_connections 2024-09-11T14:27:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.547+0000 7ff879b28ec0 1 -- 172.21.15.97:0/3160661060 wait complete. 2024-09-11T14:27:38.551 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota f2397458-472b-40b3-b6c8-73884edb56f3 max_bytes 100 2024-09-11T14:27:38.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.640+0000 7f59ab991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:38.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.649+0000 7f59ab991640 1 Processor -- start 2024-09-11T14:27:38.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.649+0000 7f59ab991640 1 -- start start 2024-09-11T14:27:38.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.650+0000 7f59ab991640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59a409c6a0 0x7f59a409cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:38.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.650+0000 7f59ab991640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a409eb70 con 0x7f59a409cff0 2024-09-11T14:27:38.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.650+0000 7f59ab991640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f59a4076180 con 0x7f59a409c6a0 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.650+0000 7f59a972d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59a409c6a0 0x7f59a409cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f59a972d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59a409c6a0 0x7f59a409cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46342/0 (socket says 172.21.15.97:46342) 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f59a8f2c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f59a409cff0 0x7f59a41332f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:44806/0 (socket says 172.21.15.97:44806) 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f59a972d640 1 -- 172.21.15.97:0/2031800027 learned_addr learned my addr 172.21.15.97:0/2031800027 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f59a972d640 1 -- 172.21.15.97:0/2031800027 >> v1:172.21.15.97:6789/0 conn(0x7f59a409cff0 legacy=0x7f59a41332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f59a972d640 1 -- 172.21.15.97:0/2031800027 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a409e290 con 0x7f59a409c6a0 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f59a972d640 1 --2- 172.21.15.97:0/2031800027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a409cab0 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56a03bc5091a354 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f599bfff640 1 -- 172.21.15.97:0/2031800027 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59a0009e50 con 0x7f59a409c6a0 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f599bfff640 1 -- 172.21.15.97:0/2031800027 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59a000e230 con 0x7f59a409c6a0 2024-09-11T14:27:38.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.651+0000 7f599bfff640 1 -- 172.21.15.97:0/2031800027 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59a000e4d0 con 0x7f59a409c6a0 2024-09-11T14:27:38.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 1 -- 172.21.15.97:0/2031800027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 msgr2=0x7f59a409cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:38.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 1 --2- 172.21.15.97:0/2031800027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a409cab0 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 1 -- 172.21.15.97:0/2031800027 shutdown_connections 2024-09-11T14:27:38.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 1 --2- 172.21.15.97:0/2031800027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a409cab0 unknown :-1 s=CLOSED pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:38.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 1 -- 172.21.15.97:0/2031800027 >> 172.21.15.97:0/2031800027 conn(0x7f59a40a30a0 msgr2=0x7f59a40a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:38.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 1 -- 172.21.15.97:0/2031800027 shutdown_connections 2024-09-11T14:27:38.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 1 -- 172.21.15.97:0/2031800027 wait complete. 2024-09-11T14:27:38.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.652+0000 7f59ab991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:38.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.653+0000 7f59ab991640 1 Processor -- start 2024-09-11T14:27:38.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.654+0000 7f59ab991640 1 -- start start 2024-09-11T14:27:38.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59ab991640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a41c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59ab991640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59a41300c0 con 0x7f59a409c6a0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59a972d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a41c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59a972d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a41c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46344/0 (socket says 172.21.15.97:46344) 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59a972d640 1 -- 172.21.15.97:0/1033281073 learned_addr learned my addr 172.21.15.97:0/1033281073 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59a972d640 1 -- 172.21.15.97:0/1033281073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a406e3d0 con 0x7f59a409c6a0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59a972d640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a41c89e0 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59a000ee20 con 0x7f59a409c6a0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59a0015420 con 0x7f59a409c6a0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a4132ee0 con 0x7f59a409c6a0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59a00156c0 con 0x7f59a409c6a0 2024-09-11T14:27:38.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.655+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a4132000 con 0x7f59a409c6a0 2024-09-11T14:27:38.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.656+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f59a0015870 con 0x7f59a409c6a0 2024-09-11T14:27:38.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.656+0000 7f5999ffb640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f598803e930 0x7f5988040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:27:38.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.656+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a4051040 con 0x7f59a409c6a0 2024-09-11T14:27:38.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.657+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(698..698 src has 397..698) ==== 3819+0+0 (crc 0 0 0) 0x7f59a00511b0 con 0x7f59a409c6a0 2024-09-11T14:27:38.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.657+0000 7f59a8f2c640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f598803e930 0x7f5988040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:27:38.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.657+0000 7f59a8f2c640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f598803e930 0x7f5988040e40 crc :-1 s=READY pgs=3786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:27:38.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.662+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f59a0014c60 con 0x7f59a409c6a0 2024-09-11T14:27:38.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:38.839+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "100"} v 0) -- 0x7f59a409da90 con 0x7f59a409c6a0 2024-09-11T14:27:39.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:39.821+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v699) ==== 221+0+0 (crc 0 0 0) 0x7f59a0010310 con 0x7f59a409c6a0 2024-09-11T14:27:39.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:39.951+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "100"} v 0) -- 0x7f59a4074650 con 0x7f59a409c6a0 2024-09-11T14:27:40.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.824+0000 7f5999ffb640 1 -- 172.21.15.97:0/1033281073 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v700) ==== 221+0+0 (crc 0 0 0) 0x7f59a0010a00 con 0x7f59a409c6a0 2024-09-11T14:27:40.826 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_bytes = 100 for pool f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f598803e930 msgr2=0x7f5988040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f598803e930 0x7f5988040e40 crc :-1 s=READY pgs=3786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 msgr2=0x7f59a41c89e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a41c89e0 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 shutdown_connections 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f598803e930 0x7f5988040e40 unknown :-1 s=CLOSED pgs=3786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 --2- 172.21.15.97:0/1033281073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59a409c6a0 0x7f59a41c89e0 unknown :-1 s=CLOSED pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:27:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 >> 172.21.15.97:0/1033281073 conn(0x7f59a40a30a0 msgr2=0x7f59a4071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:27:40.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 shutdown_connections 2024-09-11T14:27:40.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:27:40.827+0000 7f59ab991640 1 -- 172.21.15.97:0/1033281073 wait complete. 2024-09-11T14:27:40.842 INFO:tasks.workunit.client.0.smithi097.stderr:+ sleep 30 2024-09-11T14:28:10.844 INFO:tasks.workunit.client.0.smithi097.stderr:+ pid=96311 2024-09-11T14:28:10.845 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota f2397458-472b-40b3-b6c8-73884edb56f3 max_bytes 0 2024-09-11T14:28:10.845 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put two /etc/passwd 2024-09-11T14:28:10.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.883+0000 7efe4ce3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:10.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.889+0000 7efe4ce3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:10.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.889+0000 7efe4ce3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:10.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.889+0000 7efe4ce3aec0 1 Processor -- start 2024-09-11T14:28:10.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.890+0000 7efe4ce3aec0 1 -- start start 2024-09-11T14:28:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe4ce3aec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x721e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe4ce3aec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x689520 con 0x71cfc0 2024-09-11T14:28:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe44f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x721e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe44f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x721e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38402/0 (socket says 172.21.15.97:38402) 2024-09-11T14:28:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe44f9b640 1 -- 172.21.15.97:0/984130124 learned_addr learned my addr 172.21.15.97:0/984130124 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe44f9b640 1 -- 172.21.15.97:0/984130124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x625e10 con 0x71cfc0 2024-09-11T14:28:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe44f9b640 1 --2- 172.21.15.97:0/984130124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x721e70 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f1f20664cca7fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe3e7fc640 1 -- 172.21.15.97:0/984130124 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe3800b580 con 0x71cfc0 2024-09-11T14:28:10.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe3e7fc640 1 -- 172.21.15.97:0/984130124 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efe3800b6e0 con 0x71cfc0 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.891+0000 7efe3e7fc640 1 -- 172.21.15.97:0/984130124 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe3800b980 con 0x71cfc0 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.892+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/984130124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 msgr2=0x721e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.892+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/984130124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x721e70 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.892+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/984130124 shutdown_connections 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.892+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/984130124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x721e70 unknown :-1 s=CLOSED pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.892+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/984130124 >> 172.21.15.97:0/984130124 conn(0x649770 msgr2=0x720c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.892+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/984130124 shutdown_connections 2024-09-11T14:28:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.892+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/984130124 wait complete. 2024-09-11T14:28:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.893+0000 7efe4ce3aec0 1 Processor -- start 2024-09-11T14:28:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.893+0000 7efe4ce3aec0 1 -- start start 2024-09-11T14:28:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.894+0000 7efe4ce3aec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x84b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.894+0000 7efe4ce3aec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x687280 con 0x71cfc0 2024-09-11T14:28:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.894+0000 7efe44f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x84b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.894+0000 7efe44f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x84b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38404/0 (socket says 172.21.15.97:38404) 2024-09-11T14:28:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.894+0000 7efe44f9b640 1 -- 172.21.15.97:0/1918188387 learned_addr learned my addr 172.21.15.97:0/1918188387 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.895+0000 7efe44f9b640 1 -- 172.21.15.97:0/1918188387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x617920 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.895+0000 7efe44f9b640 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x84b240 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.895+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe380129e0 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.895+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efe38005040 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.895+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x617380 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.895+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe38012c70 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.895+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x83ed20 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.896+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efe3800d040 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.896+0000 7efe3d7fa640 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7efe2003d1c0 0x7efe2003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.896+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(702..702 src has 397..702) ==== 3819+0+0 (crc 0 0 0) 0x7efe3800a040 con 0x71cfc0 2024-09-11T14:28:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.897+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7efe200434b0 con 0x71cfc0 2024-09-11T14:28:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.897+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/1918188387 >> v2:172.21.15.117:6808/4196478755 conn(0x725300 0x83d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.897+0000 7efe3f7fe640 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7efe2003d1c0 0x7efe2003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.897+0000 7efe3f7fe640 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7efe2003d1c0 0x7efe2003f6d0 crc :-1 s=READY pgs=3787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.898+0000 7efe4579c640 1 --2- 172.21.15.97:0/1918188387 >> v2:172.21.15.117:6808/4196478755 conn(0x725300 0x83d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:10.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.902+0000 7efe4579c640 1 --2- 172.21.15.97:0/1918188387 >> v2:172.21.15.117:6808/4196478755 conn(0x725300 0x83d080 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:10.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.935+0000 7f276ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.945+0000 7f276ed51640 1 Processor -- start 2024-09-11T14:28:10.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.945+0000 7f276ed51640 1 -- start start 2024-09-11T14:28:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276ed51640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f276806e6e0 0x7f276806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276ed51640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276806dd50 con 0x7f2768136070 2024-09-11T14:28:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276ed51640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f276806e290 con 0x7f276806e6e0 2024-09-11T14:28:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276caed640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f276806e6e0 0x7f276806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276caed640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f276806e6e0 0x7f276806eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38408/0 (socket says 172.21.15.97:38408) 2024-09-11T14:28:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276caed640 1 -- 172.21.15.97:0/4096095397 learned_addr learned my addr 172.21.15.97:0/4096095397 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:10.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f2767fff640 1 --1- 172.21.15.97:0/4096095397 >> v1:172.21.15.97:6789/0 conn(0x7f2768136070 0x7f2768136480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40700/0 (socket says 172.21.15.97:40700) 2024-09-11T14:28:10.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276caed640 1 -- 172.21.15.97:0/4096095397 >> v1:172.21.15.97:6789/0 conn(0x7f2768136070 legacy=0x7f2768136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:10.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276caed640 1 -- 172.21.15.97:0/4096095397 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276806f590 con 0x7f276806e6e0 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f27677fe640 1 -- 172.21.15.97:0/4096095397 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769727695 0 0) 0x7f276806dd50 con 0x7f2768136070 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.946+0000 7f276caed640 1 --2- 172.21.15.97:0/4096095397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f276806eaf0 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b4f73fd8d6a352 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f27677fe640 1 -- 172.21.15.97:0/4096095397 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f275c009e40 con 0x7f276806e6e0 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f27677fe640 1 -- 172.21.15.97:0/4096095397 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f275c00e230 con 0x7f276806e6e0 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f27677fe640 1 -- 172.21.15.97:0/4096095397 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f275c00e4d0 con 0x7f276806e6e0 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f276ed51640 1 -- 172.21.15.97:0/4096095397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 msgr2=0x7f276806eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f276ed51640 1 --2- 172.21.15.97:0/4096095397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f276806eaf0 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f276ed51640 1 -- 172.21.15.97:0/4096095397 shutdown_connections 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f276ed51640 1 --2- 172.21.15.97:0/4096095397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f276806eaf0 unknown :-1 s=CLOSED pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.947+0000 7f276ed51640 1 -- 172.21.15.97:0/4096095397 >> 172.21.15.97:0/4096095397 conn(0x7f27680a31b0 msgr2=0x7f27680a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.948+0000 7f276ed51640 1 -- 172.21.15.97:0/4096095397 shutdown_connections 2024-09-11T14:28:10.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.948+0000 7f276ed51640 1 -- 172.21.15.97:0/4096095397 wait complete. 2024-09-11T14:28:10.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.948+0000 7f276ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:10.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.949+0000 7f276ed51640 1 Processor -- start 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.949+0000 7f276ed51640 1 -- start start 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.950+0000 7f276ed51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f2768121e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.950+0000 7f276ed51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2768125e30 con 0x7f276806e6e0 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.950+0000 7f276caed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f2768121e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.950+0000 7f276caed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f2768121e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38424/0 (socket says 172.21.15.97:38424) 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.950+0000 7f276caed640 1 -- 172.21.15.97:0/2414874723 learned_addr learned my addr 172.21.15.97:0/2414874723 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.951+0000 7f276caed640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27681331d0 con 0x7f276806e6e0 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.951+0000 7f276caed640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f2768121e20 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.951+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f275c00edc0 con 0x7f276806e6e0 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.951+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f275c015420 con 0x7f276806e6e0 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.951+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27681240b0 con 0x7f276806e6e0 2024-09-11T14:28:10.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.951+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f275c0156c0 con 0x7f276806e6e0 2024-09-11T14:28:10.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.951+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2768132b10 con 0x7f276806e6e0 2024-09-11T14:28:10.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.952+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f275c0158c0 con 0x7f276806e6e0 2024-09-11T14:28:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.952+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2768070290 con 0x7f276806e6e0 2024-09-11T14:28:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.952+0000 7f27657fa640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f274c03e8e0 0x7f274c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.952+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(702..702 src has 397..702) ==== 3819+0+0 (crc 0 0 0) 0x7f275c050f70 con 0x7f276806e6e0 2024-09-11T14:28:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.952+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f274c044b70 con 0x7f276806e6e0 2024-09-11T14:28:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.953+0000 7f2767fff640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f274c03e8e0 0x7f274c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:10.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.953+0000 7f2767fff640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f274c03e8e0 0x7f274c040df0 crc :-1 s=READY pgs=3788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:10.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:10.957+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f275c014c60 con 0x7f276806e6e0 2024-09-11T14:28:11.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:11.133+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"} v 0) -- 0x7f27681331d0 con 0x7f276806e6e0 2024-09-11T14:28:11.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:11.436+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v703) ==== 217+0+0 (crc 0 0 0) 0x7f27681331d0 con 0x7f276806e6e0 2024-09-11T14:28:11.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:11.439+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(703..703 src has 397..703) ==== 628+0+0 (crc 0 0 0) 0x7f275c012d40 con 0x7f276806e6e0 2024-09-11T14:28:11.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:11.439+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 6 ==== osd_map(703..703 src has 397..703) ==== 628+0+0 (crc 0 0 0) 0x7efe38013dc0 con 0x71cfc0 2024-09-11T14:28:11.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:11.439+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7f274c045b20 con 0x7f276806e6e0 2024-09-11T14:28:11.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:11.439+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7efe20043bf0 con 0x71cfc0 2024-09-11T14:28:11.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:11.557+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"} v 0) -- 0x7f27681331d0 con 0x7f276806e6e0 2024-09-11T14:28:12.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.437+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v704) ==== 217+0+0 (crc 0 0 0) 0x7f27681331d0 con 0x7f276806e6e0 2024-09-11T14:28:12.439 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_bytes = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:28:12.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f27657fa640 1 -- 172.21.15.97:0/2414874723 <== mon.0 v2:172.21.15.97:3300/0 10 ==== osd_map(704..704 src has 397..704) ==== 628+0+0 (crc 0 0 0) 0x7f275c011da0 con 0x7f276806e6e0 2024-09-11T14:28:12.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 7 ==== osd_map(704..704 src has 397..704) ==== 628+0+0 (crc 0 0 0) 0x7efe3800ccf0 con 0x71cfc0 2024-09-11T14:28:12.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=705}) -- 0x7efe20043e70 con 0x71cfc0 2024-09-11T14:28:12.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f274c03e8e0 msgr2=0x7f274c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:12.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f274c03e8e0 0x7f274c040df0 crc :-1 s=READY pgs=3788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 msgr2=0x7f2768121e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f2768121e20 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 shutdown_connections 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f274c03e8e0 0x7f274c040df0 unknown :-1 s=CLOSED pgs=3788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 --2- 172.21.15.97:0/2414874723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f276806e6e0 0x7f2768121e20 unknown :-1 s=CLOSED pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 >> 172.21.15.97:0/2414874723 conn(0x7f27680a31b0 msgr2=0x7f2768133370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 shutdown_connections 2024-09-11T14:28:12.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.440+0000 7f276ed51640 1 -- 172.21.15.97:0/2414874723 wait complete. 2024-09-11T14:28:12.457 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota f2397458-472b-40b3-b6c8-73884edb56f3 max_objects 0 2024-09-11T14:28:12.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.549+0000 7f75fa2ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:12.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.559+0000 7f75fa2ec640 1 Processor -- start 2024-09-11T14:28:12.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.559+0000 7f75fa2ec640 1 -- start start 2024-09-11T14:28:12.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75fa2ec640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f75f406f5d0 0x7f75f413b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:12.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75fa2ec640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f4074c40 con 0x7f75f406eab0 2024-09-11T14:28:12.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75fa2ec640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f75f40a5f00 con 0x7f75f406f5d0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75f3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f75f406eab0 0x7f75f406eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58848/0 (socket says 172.21.15.97:58848) 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75f3fff640 1 -- 172.21.15.97:0/3436741226 learned_addr learned my addr 172.21.15.97:0/3436741226 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75ebfff640 1 --2- 172.21.15.97:0/3436741226 >> v2:172.21.15.97:3300/0 conn(0x7f75f406f5d0 0x7f75f413b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75f37fe640 1 -- 172.21.15.97:0/3436741226 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271923948 0 0) 0x7f75f4074c40 con 0x7f75f406eab0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75f37fe640 1 -- 172.21.15.97:0/3436741226 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75e0003580 con 0x7f75f406eab0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75ebfff640 1 -- 172.21.15.97:0/3436741226 >> v1:172.21.15.97:6789/0 conn(0x7f75f406eab0 legacy=0x7f75f406eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.560+0000 7f75ebfff640 1 -- 172.21.15.97:0/3436741226 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f40a6290 con 0x7f75f406f5d0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.561+0000 7f75ebfff640 1 --2- 172.21.15.97:0/3436741226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406f5d0 0x7f75f413b350 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5500e8d38968e56d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.561+0000 7f75f37fe640 1 -- 172.21.15.97:0/3436741226 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f75dc009d90 con 0x7f75f406f5d0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.561+0000 7f75f37fe640 1 -- 172.21.15.97:0/3436741226 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f75dc00e230 con 0x7f75f406f5d0 2024-09-11T14:28:12.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.561+0000 7f75f37fe640 1 -- 172.21.15.97:0/3436741226 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f75dc00e4d0 con 0x7f75f406f5d0 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 1 -- 172.21.15.97:0/3436741226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406f5d0 msgr2=0x7f75f413b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 1 --2- 172.21.15.97:0/3436741226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406f5d0 0x7f75f413b350 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 1 -- 172.21.15.97:0/3436741226 shutdown_connections 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 1 --2- 172.21.15.97:0/3436741226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406f5d0 0x7f75f413b350 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 1 -- 172.21.15.97:0/3436741226 >> 172.21.15.97:0/3436741226 conn(0x7f75f40a43d0 msgr2=0x7f75f40a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 1 -- 172.21.15.97:0/3436741226 shutdown_connections 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 1 -- 172.21.15.97:0/3436741226 wait complete. 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.562+0000 7f75fa2ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.563+0000 7f75fa2ec640 1 Processor -- start 2024-09-11T14:28:12.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.563+0000 7f75fa2ec640 1 -- start start 2024-09-11T14:28:12.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.564+0000 7f75fa2ec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406eab0 0x7f75f4123780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:12.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.564+0000 7f75fa2ec640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75f4125200 con 0x7f75f406eab0 2024-09-11T14:28:12.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.564+0000 7f75f3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406eab0 0x7f75f4123780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:12.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.564+0000 7f75f3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406eab0 0x7f75f4123780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41604/0 (socket says 172.21.15.97:41604) 2024-09-11T14:28:12.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.564+0000 7f75f3fff640 1 -- 172.21.15.97:0/227348819 learned_addr learned my addr 172.21.15.97:0/227348819 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:12.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.565+0000 7f75f3fff640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f4136ad0 con 0x7f75f406eab0 2024-09-11T14:28:12.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.565+0000 7f75f3fff640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406eab0 0x7f75f4123780 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:12.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.565+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f75e4005a60 con 0x7f75f406eab0 2024-09-11T14:28:12.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.565+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f75e4005bc0 con 0x7f75f406eab0 2024-09-11T14:28:12.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.565+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f41249c0 con 0x7f75f406eab0 2024-09-11T14:28:12.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.565+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f75e4005e60 con 0x7f75f406eab0 2024-09-11T14:28:12.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.565+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f4126090 con 0x7f75f406eab0 2024-09-11T14:28:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.566+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f4127860 con 0x7f75f406eab0 2024-09-11T14:28:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.566+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f75e40070b0 con 0x7f75f406eab0 2024-09-11T14:28:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.566+0000 7f75f17fa640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f75d403e930 0x7f75d4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.567+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(704..704 src has 397..704) ==== 3819+0+0 (crc 0 0 0) 0x7f75e404fb20 con 0x7f75f406eab0 2024-09-11T14:28:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.567+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=705}) -- 0x7f75d4044bc0 con 0x7f75f406eab0 2024-09-11T14:28:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.567+0000 7f75ebfff640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f75d403e930 0x7f75d4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:12.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.567+0000 7f75ebfff640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f75d403e930 0x7f75d4040e40 crc :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:12.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.572+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f75f4127860 con 0x7f75f406eab0 2024-09-11T14:28:12.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:12.746+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"} v 0) -- 0x7f75f4127860 con 0x7f75f406eab0 2024-09-11T14:28:13.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.428+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v705) ==== 221+0+0 (crc 0 0 0) 0x7f75f4127860 con 0x7f75f406eab0 2024-09-11T14:28:13.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.431+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(705..705 src has 397..705) ==== 628+0+0 (crc 0 0 0) 0x7efe3800c600 con 0x71cfc0 2024-09-11T14:28:13.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.431+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(705..705 src has 397..705) ==== 628+0+0 (crc 0 0 0) 0x7f75e400da00 con 0x7f75f406eab0 2024-09-11T14:28:13.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.431+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7efe20044060 con 0x71cfc0 2024-09-11T14:28:13.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.431+0000 7efe3d7fa640 1 -- 172.21.15.97:0/1918188387 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x7efe20044250 con 0x725300 2024-09-11T14:28:13.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.431+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f75d4045bb0 con 0x7f75f406eab0 2024-09-11T14:28:13.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4579c640 1 -- 172.21.15.97:0/1918188387 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 two [writefull 0~12777] v705'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7efe3000a430 con 0x725300 2024-09-11T14:28:13.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 >> v2:172.21.15.117:6808/4196478755 conn(0x725300 msgr2=0x83d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:13.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/1918188387 >> v2:172.21.15.117:6808/4196478755 conn(0x725300 0x83d080 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:13.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7efe2003d1c0 msgr2=0x7efe2003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7efe2003d1c0 0x7efe2003f6d0 crc :-1 s=READY pgs=3787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 msgr2=0x84b240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x84b240 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 shutdown_connections 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/1918188387 >> v2:172.21.15.117:6808/4196478755 conn(0x725300 0x83d080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7efe2003d1c0 0x7efe2003f6d0 unknown :-1 s=CLOSED pgs=3787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 --2- 172.21.15.97:0/1918188387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x71cfc0 0x84b240 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 >> 172.21.15.97:0/1918188387 conn(0x649770 msgr2=0x7209a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.477+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 shutdown_connections 2024-09-11T14:28:13.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.478+0000 7efe4ce3aec0 1 -- 172.21.15.97:0/1918188387 wait complete. 2024-09-11T14:28:13.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:13.552+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"} v 0) -- 0x7f75f4127860 con 0x7f75f406eab0 2024-09-11T14:28:14.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.451+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v706) ==== 221+0+0 (crc 0 0 0) 0x7f75f4127860 con 0x7f75f406eab0 2024-09-11T14:28:14.454 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_objects = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:28:14.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.452+0000 7f75f17fa640 1 -- 172.21.15.97:0/227348819 <== mon.0 v2:172.21.15.97:3300/0 10 ==== osd_map(706..706 src has 397..706) ==== 628+0+0 (crc 0 0 0) 0x7f75e40090b0 con 0x7f75f406eab0 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f75d403e930 msgr2=0x7f75d4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f75d403e930 0x7f75d4040e40 crc :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406eab0 msgr2=0x7f75f4123780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406eab0 0x7f75f4123780 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 shutdown_connections 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f75d403e930 0x7f75d4040e40 unknown :-1 s=CLOSED pgs=3789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 --2- 172.21.15.97:0/227348819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75f406eab0 0x7f75f4123780 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 >> 172.21.15.97:0/227348819 conn(0x7f75f40a43d0 msgr2=0x7f75f411cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 shutdown_connections 2024-09-11T14:28:14.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.454+0000 7f75fa2ec640 1 -- 172.21.15.97:0/227348819 wait complete. 2024-09-11T14:28:14.471 INFO:tasks.workunit.client.0.smithi097.stderr:+ wait 96311 2024-09-11T14:28:14.471 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T14:28:14.472 INFO:tasks.workunit.client.0.smithi097.stderr:+ true 2024-09-11T14:28:14.472 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put three /etc/passwd 2024-09-11T14:28:14.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.511+0000 7fabb4d31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:14.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.516+0000 7fabb4d31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.516+0000 7fabb4d31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.517+0000 7fabb4d31ec0 1 Processor -- start 2024-09-11T14:28:14.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.517+0000 7fabb4d31ec0 1 -- start start 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.518+0000 7fabb4d31ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.518+0000 7fabb4d31ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1b78520 con 0x1c14300 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.518+0000 7fabad63f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.518+0000 7fabad63f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c112c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41626/0 (socket says 172.21.15.97:41626) 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.518+0000 7fabad63f640 1 -- 172.21.15.97:0/2906245176 learned_addr learned my addr 172.21.15.97:0/2906245176 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7fabad63f640 1 -- 172.21.15.97:0/2906245176 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b14e10 con 0x1c14300 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7fabad63f640 1 --2- 172.21.15.97:0/2906245176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c112c0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176b21d29746d805 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:14.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7faba6ffd640 1 -- 172.21.15.97:0/2906245176 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab9800d790 con 0x1c14300 2024-09-11T14:28:14.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7faba6ffd640 1 -- 172.21.15.97:0/2906245176 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab9800d8f0 con 0x1c14300 2024-09-11T14:28:14.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7faba6ffd640 1 -- 172.21.15.97:0/2906245176 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab9800db90 con 0x1c14300 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/2906245176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 msgr2=0x1c112c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/2906245176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c112c0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/2906245176 shutdown_connections 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/2906245176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c112c0 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.519+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/2906245176 >> 172.21.15.97:0/2906245176 conn(0x1b38770 msgr2=0x1c166f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.520+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/2906245176 shutdown_connections 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.520+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/2906245176 wait complete. 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.520+0000 7fabb4d31ec0 1 Processor -- start 2024-09-11T14:28:14.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.520+0000 7fabb4d31ec0 1 -- start start 2024-09-11T14:28:14.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.521+0000 7fabb4d31ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c90090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.521+0000 7fabb4d31ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1b76280 con 0x1c14300 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.521+0000 7fabad63f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c90090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.521+0000 7fabad63f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c90090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41642/0 (socket says 172.21.15.97:41642) 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.521+0000 7fabad63f640 1 -- 172.21.15.97:0/644253240 learned_addr learned my addr 172.21.15.97:0/644253240 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.522+0000 7fabad63f640 1 -- 172.21.15.97:0/644253240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b06920 con 0x1c14300 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.522+0000 7fabad63f640 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c90090 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.522+0000 7faba5ffb640 1 -- 172.21.15.97:0/644253240 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab980094b0 con 0x1c14300 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.522+0000 7faba5ffb640 1 -- 172.21.15.97:0/644253240 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab98013040 con 0x1c14300 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.522+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b06380 con 0x1c14300 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.522+0000 7faba5ffb640 1 -- 172.21.15.97:0/644253240 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab98009740 con 0x1c14300 2024-09-11T14:28:14.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.522+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ca1e30 con 0x1c14300 2024-09-11T14:28:14.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.523+0000 7faba5ffb640 1 -- 172.21.15.97:0/644253240 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fab980098f0 con 0x1c14300 2024-09-11T14:28:14.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.523+0000 7faba5ffb640 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab9403d1c0 0x7fab9403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:14.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.523+0000 7faba5ffb640 1 -- 172.21.15.97:0/644253240 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(706..706 src has 397..706) ==== 3819+0+0 (crc 0 0 0) 0x7fab98051e70 con 0x1c14300 2024-09-11T14:28:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.523+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/644253240 >> v2:172.21.15.117:6808/4196478755 conn(0x1c14e20 0x213d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.523+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1c933c0 con 0x1c14e20 2024-09-11T14:28:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.524+0000 7fabace3e640 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab9403d1c0 0x7fab9403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.524+0000 7fabace3e640 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab9403d1c0 0x7fab9403f6d0 crc :-1 s=READY pgs=3790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:14.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.524+0000 7fabade40640 1 --2- 172.21.15.97:0/644253240 >> v2:172.21.15.117:6808/4196478755 conn(0x1c14e20 0x213d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:14.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.528+0000 7fabade40640 1 --2- 172.21.15.97:0/644253240 >> v2:172.21.15.117:6808/4196478755 conn(0x1c14e20 0x213d830 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabade40640 1 -- 172.21.15.97:0/644253240 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 three [writefull 0~12777] v706'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faba000a430 con 0x1c14e20 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 >> v2:172.21.15.117:6808/4196478755 conn(0x1c14e20 msgr2=0x213d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/644253240 >> v2:172.21.15.117:6808/4196478755 conn(0x1c14e20 0x213d830 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab9403d1c0 msgr2=0x7fab9403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab9403d1c0 0x7fab9403f6d0 crc :-1 s=READY pgs=3790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 msgr2=0x1c90090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c90090 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 shutdown_connections 2024-09-11T14:28:14.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/644253240 >> v2:172.21.15.117:6808/4196478755 conn(0x1c14e20 0x213d830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab9403d1c0 0x7fab9403f6d0 unknown :-1 s=CLOSED pgs=3790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 --2- 172.21.15.97:0/644253240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1c14300 0x1c90090 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 >> 172.21.15.97:0/644253240 conn(0x1b38770 msgr2=0x1c166f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:14.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 shutdown_connections 2024-09-11T14:28:14.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.542+0000 7fabb4d31ec0 1 -- 172.21.15.97:0/644253240 wait complete. 2024-09-11T14:28:14.548 INFO:tasks.workunit.client.0.smithi097.stderr:++ uuidgen 2024-09-11T14:28:14.548 INFO:tasks.workunit.client.0.smithi097.stderr:+ pp=30a1627b-5bb9-4a6c-ba13-11612e8d66f2 2024-09-11T14:28:14.548 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool create 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 12 2024-09-11T14:28:14.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.629+0000 7fb454351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:14.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.637+0000 7fb454351640 1 Processor -- start 2024-09-11T14:28:14.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.637+0000 7fb454351640 1 -- start start 2024-09-11T14:28:14.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.638+0000 7fb454351640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb44c09e960 0x7fb44c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:14.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.638+0000 7fb454351640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44c0741f0 con 0x7fb44c1341d0 2024-09-11T14:28:14.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.638+0000 7fb454351640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb44c09dd90 con 0x7fb44c09e960 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.638+0000 7fb4520ed640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb44c09e960 0x7fb44c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.638+0000 7fb4520ed640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb44c09e960 0x7fb44c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41652/0 (socket says 172.21.15.97:41652) 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.638+0000 7fb4520ed640 1 -- 172.21.15.97:0/541201162 learned_addr learned my addr 172.21.15.97:0/541201162 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.638+0000 7fb4518ec640 1 --1- 172.21.15.97:0/541201162 >> v1:172.21.15.97:6789/0 conn(0x7fb44c1341d0 0x7fb44c072770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58856/0 (socket says 172.21.15.97:58856) 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.639+0000 7fb4520ed640 1 -- 172.21.15.97:0/541201162 >> v1:172.21.15.97:6789/0 conn(0x7fb44c1341d0 legacy=0x7fb44c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.639+0000 7fb4520ed640 1 -- 172.21.15.97:0/541201162 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c074840 con 0x7fb44c09e960 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.639+0000 7fb4520ed640 1 --2- 172.21.15.97:0/541201162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c133c90 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb523a6fd9d2f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.639+0000 7fb4510eb640 1 -- 172.21.15.97:0/541201162 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb44800e040 con 0x7fb44c09e960 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.639+0000 7fb4510eb640 1 -- 172.21.15.97:0/541201162 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb4480091e0 con 0x7fb44c09e960 2024-09-11T14:28:14.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.639+0000 7fb4510eb640 1 -- 172.21.15.97:0/541201162 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb448007730 con 0x7fb44c09e960 2024-09-11T14:28:14.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 1 -- 172.21.15.97:0/541201162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 msgr2=0x7fb44c133c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:14.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 1 --2- 172.21.15.97:0/541201162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c133c90 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 1 -- 172.21.15.97:0/541201162 shutdown_connections 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 1 --2- 172.21.15.97:0/541201162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c133c90 unknown :-1 s=CLOSED pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 1 -- 172.21.15.97:0/541201162 >> 172.21.15.97:0/541201162 conn(0x7fb44c0a6fa0 msgr2=0x7fb44c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 1 -- 172.21.15.97:0/541201162 shutdown_connections 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 1 -- 172.21.15.97:0/541201162 wait complete. 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.640+0000 7fb454351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.641+0000 7fb454351640 1 Processor -- start 2024-09-11T14:28:14.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.641+0000 7fb454351640 1 -- start start 2024-09-11T14:28:14.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.642+0000 7fb454351640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c06eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:14.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.642+0000 7fb454351640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c125100 con 0x7fb44c09e960 2024-09-11T14:28:14.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.642+0000 7fb4520ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c06eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb4520ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c06eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41662/0 (socket says 172.21.15.97:41662) 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb4520ed640 1 -- 172.21.15.97:0/1829021371 learned_addr learned my addr 172.21.15.97:0/1829021371 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb4520ed640 1 -- 172.21.15.97:0/1829021371 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c070520 con 0x7fb44c09e960 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb4520ed640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c06eae0 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb44800e040 con 0x7fb44c09e960 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb448013790 con 0x7fb44c09e960 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44c124610 con 0x7fb44c09e960 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb448013a30 con 0x7fb44c09e960 2024-09-11T14:28:14.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.643+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44c133950 con 0x7fb44c09e960 2024-09-11T14:28:14.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.644+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44c125b30 con 0x7fb44c09e960 2024-09-11T14:28:14.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.644+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb448013c30 con 0x7fb44c09e960 2024-09-11T14:28:14.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.644+0000 7fb442ffd640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb43003e8e0 0x7fb430040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:14.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.644+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(706..706 src has 397..706) ==== 3819+0+0 (crc 0 0 0) 0x7fb4480512a0 con 0x7fb44c09e960 2024-09-11T14:28:14.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.645+0000 7fb4518ec640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb43003e8e0 0x7fb430040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:14.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.645+0000 7fb4518ec640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb43003e8e0 0x7fb430040df0 crc :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:14.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.649+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb448014770 con 0x7fb44c09e960 2024-09-11T14:28:14.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:14.823+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pg_num": 12} v 0) -- 0x7fb44c133ba0 con 0x7fb44c09e960 2024-09-11T14:28:15.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.455+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pg_num": 12}]=0 pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' created v707) ==== 176+0+0 (crc 0 0 0) 0x7fb44c133ba0 con 0x7fb44c09e960 2024-09-11T14:28:15.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.595+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pg_num": 12} v 0) -- 0x7fb44c133ba0 con 0x7fb44c09e960 2024-09-11T14:28:15.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.596+0000 7fb442ffd640 1 -- 172.21.15.97:0/1829021371 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pg_num": 12}]=0 pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' already exists v707) ==== 183+0+0 (crc 0 0 0) 0x7fb44c133ba0 con 0x7fb44c09e960 2024-09-11T14:28:15.598 INFO:tasks.workunit.client.0.smithi097.stderr:pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' already exists 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb43003e8e0 msgr2=0x7fb430040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb43003e8e0 0x7fb430040df0 crc :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 msgr2=0x7fb44c06eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c06eae0 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 shutdown_connections 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fb43003e8e0 0x7fb430040df0 unknown :-1 s=CLOSED pgs=3791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 --2- 172.21.15.97:0/1829021371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb44c09e960 0x7fb44c06eae0 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 >> 172.21.15.97:0/1829021371 conn(0x7fb44c0a6fa0 msgr2=0x7fb44c0a42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 shutdown_connections 2024-09-11T14:28:15.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.598+0000 7fb454351640 1 -- 172.21.15.97:0/1829021371 wait complete. 2024-09-11T14:28:15.610 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool application enable 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 rados 2024-09-11T14:28:15.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.692+0000 7f85534a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:15.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.701+0000 7f85534a3640 1 Processor -- start 2024-09-11T14:28:15.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.701+0000 7f85534a3640 1 -- start start 2024-09-11T14:28:15.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.702+0000 7f85534a3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f854c09c830 0x7f854c09cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:15.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.702+0000 7f85534a3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c06ea50 con 0x7f854c1322c0 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.702+0000 7f85534a3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f854c09d6e0 con 0x7f854c09c830 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f855123f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f854c09c830 0x7f854c09cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f855123f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f854c09c830 0x7f854c09cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41678/0 (socket says 172.21.15.97:41678) 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f855123f640 1 -- 172.21.15.97:0/1501083724 learned_addr learned my addr 172.21.15.97:0/1501083724 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f8550a3e640 1 --1- 172.21.15.97:0/1501083724 >> v1:172.21.15.97:6789/0 conn(0x7f854c1322c0 0x7f854c1326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58862/0 (socket says 172.21.15.97:58862) 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f855123f640 1 -- 172.21.15.97:0/1501083724 >> v1:172.21.15.97:6789/0 conn(0x7f854c1322c0 legacy=0x7f854c1326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f855123f640 1 -- 172.21.15.97:0/1501083724 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c09c520 con 0x7f854c09c830 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f855123f640 1 --2- 172.21.15.97:0/1501083724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c09cc40 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f04eac73b91beb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f8543fff640 1 -- 172.21.15.97:0/1501083724 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8548009e40 con 0x7f854c09c830 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f8543fff640 1 -- 172.21.15.97:0/1501083724 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f854800f340 con 0x7f854c09c830 2024-09-11T14:28:15.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.703+0000 7f8543fff640 1 -- 172.21.15.97:0/1501083724 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f854800f5e0 con 0x7f854c09c830 2024-09-11T14:28:15.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 1 -- 172.21.15.97:0/1501083724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 msgr2=0x7f854c09cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:15.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 1 --2- 172.21.15.97:0/1501083724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c09cc40 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:15.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 1 -- 172.21.15.97:0/1501083724 shutdown_connections 2024-09-11T14:28:15.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 1 --2- 172.21.15.97:0/1501083724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c09cc40 unknown :-1 s=CLOSED pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:15.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 1 -- 172.21.15.97:0/1501083724 >> 172.21.15.97:0/1501083724 conn(0x7f854c0a2000 msgr2=0x7f854c0a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:15.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 1 -- 172.21.15.97:0/1501083724 shutdown_connections 2024-09-11T14:28:15.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 1 -- 172.21.15.97:0/1501083724 wait complete. 2024-09-11T14:28:15.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.704+0000 7f85534a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:15.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.706+0000 7f85534a3640 1 Processor -- start 2024-09-11T14:28:15.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.706+0000 7f85534a3640 1 -- start start 2024-09-11T14:28:15.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f85534a3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c08f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f85534a3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f854c09af30 con 0x7f854c09c830 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f855123f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c08f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f855123f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c08f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41694/0 (socket says 172.21.15.97:41694) 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f855123f640 1 -- 172.21.15.97:0/1246958930 learned_addr learned my addr 172.21.15.97:0/1246958930 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f855123f640 1 -- 172.21.15.97:0/1246958930 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c08fe20 con 0x7f854c09c830 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f855123f640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c08f6e0 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f854800fea0 con 0x7f854c09c830 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8548012430 con 0x7f854c09c830 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c08f310 con 0x7f854c09c830 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.707+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f85480126d0 con 0x7f854c09c830 2024-09-11T14:28:15.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.708+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c0747a0 con 0x7f854c09c830 2024-09-11T14:28:15.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.709+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c09b600 con 0x7f854c09c830 2024-09-11T14:28:15.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.709+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8548012880 con 0x7f854c09c830 2024-09-11T14:28:15.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.709+0000 7f8541ffb640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f853003e930 0x7f8530040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:15.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.709+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(707..707 src has 397..707) ==== 4194+0+0 (crc 0 0 0) 0x7f8548050c70 con 0x7f854c09c830 2024-09-11T14:28:15.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.709+0000 7f8550a3e640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f853003e930 0x7f8530040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:15.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.710+0000 7f8550a3e640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f853003e930 0x7f8530040e40 crc :-1 s=READY pgs=3792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:15.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.714+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f854800cbc0 con 0x7f854c09c830 2024-09-11T14:28:15.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:15.890+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "app": "rados"} v 0) -- 0x7f854c09ff00 con 0x7f854c09c830 2024-09-11T14:28:16.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:16.459+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "app": "rados"}]=0 enabled application 'rados' on pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' v708) ==== 213+0+0 (crc 0 0 0) 0x7f854800c9e0 con 0x7f854c09c830 2024-09-11T14:28:16.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:16.625+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "app": "rados"} v 0) -- 0x7f854c1314a0 con 0x7f854c09c830 2024-09-11T14:28:17.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.463+0000 7f8541ffb640 1 -- 172.21.15.97:0/1246958930 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "app": "rados"}]=0 enabled application 'rados' on pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' v709) ==== 213+0+0 (crc 0 0 0) 0x7f854800cbc0 con 0x7f854c09c830 2024-09-11T14:28:17.466 INFO:tasks.workunit.client.0.smithi097.stderr:enabled application 'rados' on pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' 2024-09-11T14:28:17.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f853003e930 msgr2=0x7f8530040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:17.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f853003e930 0x7f8530040e40 crc :-1 s=READY pgs=3792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:17.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 msgr2=0x7f854c08f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:17.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c08f6e0 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:17.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 shutdown_connections 2024-09-11T14:28:17.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f853003e930 0x7f8530040e40 unknown :-1 s=CLOSED pgs=3792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:17.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 --2- 172.21.15.97:0/1246958930 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f854c09c830 0x7f854c08f6e0 unknown :-1 s=CLOSED pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:17.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 >> 172.21.15.97:0/1246958930 conn(0x7f854c0a2000 msgr2=0x7f854c071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:17.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 shutdown_connections 2024-09-11T14:28:17.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.467+0000 7f85534a3640 1 -- 172.21.15.97:0/1246958930 wait complete. 2024-09-11T14:28:17.484 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 max_objects 10 2024-09-11T14:28:17.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.595+0000 7f65e4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:17.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.605+0000 7f65e4b91640 1 Processor -- start 2024-09-11T14:28:17.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.606+0000 7f65e4b91640 1 -- start start 2024-09-11T14:28:17.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.607+0000 7f65e4b91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e01355f0 0x7f65e0137a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.607+0000 7f65e4b91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e006ea50 con 0x7f65e009c830 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.607+0000 7f65e4b91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f65e009d350 con 0x7f65e01355f0 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65ddd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e01355f0 0x7f65e0137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65ddd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e01355f0 0x7f65e0137a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41702/0 (socket says 172.21.15.97:41702) 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65ddd9b640 1 -- 172.21.15.97:0/170985219 learned_addr learned my addr 172.21.15.97:0/170985219 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65de59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f65e009c830 0x7f65e009cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58876/0 (socket says 172.21.15.97:58876) 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65ddd9b640 1 -- 172.21.15.97:0/170985219 >> v1:172.21.15.97:6789/0 conn(0x7f65e009c830 legacy=0x7f65e009cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65ddd9b640 1 -- 172.21.15.97:0/170985219 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e009d6e0 con 0x7f65e01355f0 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65ddd9b640 1 --2- 172.21.15.97:0/170985219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e01355f0 0x7f65e0137a10 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66076ecf4c05f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65dd59a640 1 -- 172.21.15.97:0/170985219 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65c8009e40 con 0x7f65e01355f0 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65dd59a640 1 -- 172.21.15.97:0/170985219 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f65c800e230 con 0x7f65e01355f0 2024-09-11T14:28:17.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.608+0000 7f65dd59a640 1 -- 172.21.15.97:0/170985219 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65c800e4d0 con 0x7f65e01355f0 2024-09-11T14:28:17.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.609+0000 7f65e4b91640 1 -- 172.21.15.97:0/170985219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e01355f0 msgr2=0x7f65e0137a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:17.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.609+0000 7f65e4b91640 1 --2- 172.21.15.97:0/170985219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e01355f0 0x7f65e0137a10 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.609+0000 7f65e4b91640 1 -- 172.21.15.97:0/170985219 shutdown_connections 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.609+0000 7f65e4b91640 1 --2- 172.21.15.97:0/170985219 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e01355f0 0x7f65e0137a10 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.609+0000 7f65e4b91640 1 -- 172.21.15.97:0/170985219 >> 172.21.15.97:0/170985219 conn(0x7f65e00a2000 msgr2=0x7f65e00a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.609+0000 7f65e4b91640 1 -- 172.21.15.97:0/170985219 shutdown_connections 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.609+0000 7f65e4b91640 1 -- 172.21.15.97:0/170985219 wait complete. 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.610+0000 7f65e4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.611+0000 7f65e4b91640 1 Processor -- start 2024-09-11T14:28:17.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.611+0000 7f65e4b91640 1 -- start start 2024-09-11T14:28:17.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65e4b91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e009c830 0x7f65e01c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:17.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65e4b91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f65e00a01f0 con 0x7f65e009c830 2024-09-11T14:28:17.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65de59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e009c830 0x7f65e01c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65de59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e009c830 0x7f65e01c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41704/0 (socket says 172.21.15.97:41704) 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65de59c640 1 -- 172.21.15.97:0/3399044240 learned_addr learned my addr 172.21.15.97:0/3399044240 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65de59c640 1 -- 172.21.15.97:0/3399044240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e0132010 con 0x7f65e009c830 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65de59c640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e009c830 0x7f65e01c8b70 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65d800f230 con 0x7f65e009c830 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e009be90 con 0x7f65e009c830 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.613+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f65d800f390 con 0x7f65e009c830 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.614+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65d800f630 con 0x7f65e009c830 2024-09-11T14:28:17.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.614+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e0131c60 con 0x7f65e009c830 2024-09-11T14:28:17.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.615+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f65d800f830 con 0x7f65e009c830 2024-09-11T14:28:17.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.615+0000 7f65d6ffd640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f65c003e8e0 0x7f65c0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:17.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.615+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e006e540 con 0x7f65e009c830 2024-09-11T14:28:17.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.615+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(709..709 src has 397..709) ==== 4207+0+0 (crc 0 0 0) 0x7f65d8050a80 con 0x7f65e009c830 2024-09-11T14:28:17.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.615+0000 7f65ddd9b640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f65c003e8e0 0x7f65c0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:17.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.616+0000 7f65ddd9b640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f65c003e8e0 0x7f65c0040df0 crc :-1 s=READY pgs=3793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:17.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.621+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f65d8011bc0 con 0x7f65e009c830 2024-09-11T14:28:17.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:17.801+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "field": "max_objects", "val": "10"} v 0) -- 0x7f65e0077c10 con 0x7f65e009c830 2024-09-11T14:28:18.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:18.430+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 v710) ==== 223+0+0 (crc 0 0 0) 0x7f65d800ee20 con 0x7f65e009c830 2024-09-11T14:28:18.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:18.576+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "field": "max_objects", "val": "10"} v 0) -- 0x7f65e01318a0 con 0x7f65e009c830 2024-09-11T14:28:19.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.467+0000 7f65d6ffd640 1 -- 172.21.15.97:0/3399044240 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 v711) ==== 223+0+0 (crc 0 0 0) 0x7f65d800d150 con 0x7f65e009c830 2024-09-11T14:28:19.470 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_objects = 10 for pool 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 2024-09-11T14:28:19.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f65c003e8e0 msgr2=0x7f65c0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:19.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f65c003e8e0 0x7f65c0040df0 crc :-1 s=READY pgs=3793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:19.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e009c830 msgr2=0x7f65e01c8b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:19.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e009c830 0x7f65e01c8b70 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 shutdown_connections 2024-09-11T14:28:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f65c003e8e0 0x7f65c0040df0 unknown :-1 s=CLOSED pgs=3793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 --2- 172.21.15.97:0/3399044240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e009c830 0x7f65e01c8b70 unknown :-1 s=CLOSED pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 >> 172.21.15.97:0/3399044240 conn(0x7f65e00a2000 msgr2=0x7f65e0134210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 shutdown_connections 2024-09-11T14:28:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:19.471+0000 7f65e4b91640 1 -- 172.21.15.97:0/3399044240 wait complete. 2024-09-11T14:28:19.490 INFO:tasks.workunit.client.0.smithi097.stderr:+ sleep 30 2024-09-11T14:28:49.493 INFO:tasks.workunit.client.0.smithi097.stderr:++ seq 1 10 2024-09-11T14:28:49.494 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:49.494 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj1 /etc/passwd 2024-09-11T14:28:49.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.534+0000 7f5d1dc3dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.540+0000 7f5d1dc3dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.540+0000 7f5d1dc3dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.540+0000 7f5d1dc3dec0 1 Processor -- start 2024-09-11T14:28:49.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.540+0000 7f5d1dc3dec0 1 -- start start 2024-09-11T14:28:49.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.541+0000 7f5d1dc3dec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc7b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.541+0000 7f5d1dc3dec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xb4a520 con 0xbe6300 2024-09-11T14:28:49.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.541+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc7b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.541+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc7b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40388/0 (socket says 172.21.15.97:40388) 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.542+0000 7f5d15d9b640 1 -- 172.21.15.97:0/289200092 learned_addr learned my addr 172.21.15.97:0/289200092 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.542+0000 7f5d15d9b640 1 -- 172.21.15.97:0/289200092 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xae6e10 con 0xbe6300 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.542+0000 7f5d15d9b640 1 --2- 172.21.15.97:0/289200092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc7b0a0 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bf50fbbbbec32a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.542+0000 7f5d0f7fe640 1 -- 172.21.15.97:0/289200092 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d0000b580 con 0xbe6300 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.542+0000 7f5d0f7fe640 1 -- 172.21.15.97:0/289200092 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d0000b6e0 con 0xbe6300 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.542+0000 7f5d0f7fe640 1 -- 172.21.15.97:0/289200092 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d0000b980 con 0xbe6300 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.543+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/289200092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 msgr2=0xc7b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.543+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/289200092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc7b0a0 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.543+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/289200092 shutdown_connections 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.543+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/289200092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc7b0a0 unknown :-1 s=CLOSED pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.543+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/289200092 >> 172.21.15.97:0/289200092 conn(0xb0a770 msgr2=0xc772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.543+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/289200092 shutdown_connections 2024-09-11T14:28:49.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.543+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/289200092 wait complete. 2024-09-11T14:28:49.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.544+0000 7f5d1dc3dec0 1 Processor -- start 2024-09-11T14:28:49.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.545+0000 7f5d1dc3dec0 1 -- start start 2024-09-11T14:28:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.546+0000 7f5d1dc3dec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc61f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.546+0000 7f5d1dc3dec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xb48280 con 0xbe6300 2024-09-11T14:28:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.546+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc61f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.546+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc61f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40402/0 (socket says 172.21.15.97:40402) 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.546+0000 7f5d15d9b640 1 -- 172.21.15.97:0/2444781356 learned_addr learned my addr 172.21.15.97:0/2444781356 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.546+0000 7f5d15d9b640 1 -- 172.21.15.97:0/2444781356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xad8920 con 0xbe6300 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.546+0000 7f5d15d9b640 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc61f90 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.547+0000 7f5d0e7fc640 1 -- 172.21.15.97:0/2444781356 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d00017040 con 0xbe6300 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.547+0000 7f5d0e7fc640 1 -- 172.21.15.97:0/2444781356 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d00005040 con 0xbe6300 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.547+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xad8380 con 0xbe6300 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.547+0000 7f5d0e7fc640 1 -- 172.21.15.97:0/2444781356 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d00012d50 con 0xbe6300 2024-09-11T14:28:49.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.547+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc64e70 con 0xbe6300 2024-09-11T14:28:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.549+0000 7f5d0e7fc640 1 -- 172.21.15.97:0/2444781356 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5d0000d040 con 0xbe6300 2024-09-11T14:28:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.549+0000 7f5d0e7fc640 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5cfc03d170 0x7f5cfc03f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.549+0000 7f5d0e7fc640 1 -- 172.21.15.97:0/2444781356 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7f5d0000a040 con 0xbe6300 2024-09-11T14:28:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.549+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/2444781356 >> v2:172.21.15.117:6808/4196478755 conn(0xbe6e20 0xc629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.549+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0xd0c6e0 con 0xbe6e20 2024-09-11T14:28:49.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.549+0000 7f5d1559a640 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5cfc03d170 0x7f5cfc03f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.550+0000 7f5d1559a640 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5cfc03d170 0x7f5cfc03f680 crc :-1 s=READY pgs=3794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.551+0000 7f5d1659c640 1 --2- 172.21.15.97:0/2444781356 >> v2:172.21.15.117:6808/4196478755 conn(0xbe6e20 0xc629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:49.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.555+0000 7f5d1659c640 1 --2- 172.21.15.97:0/2444781356 >> v2:172.21.15.117:6808/4196478755 conn(0xbe6e20 0xc629e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1659c640 1 -- 172.21.15.97:0/2444781356 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 obj1 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d0800a430 con 0xbe6e20 2024-09-11T14:28:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 >> v2:172.21.15.117:6808/4196478755 conn(0xbe6e20 msgr2=0xc629e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/2444781356 >> v2:172.21.15.117:6808/4196478755 conn(0xbe6e20 0xc629e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5cfc03d170 msgr2=0x7f5cfc03f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5cfc03d170 0x7f5cfc03f680 crc :-1 s=READY pgs=3794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 msgr2=0xc61f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc61f90 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 shutdown_connections 2024-09-11T14:28:49.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/2444781356 >> v2:172.21.15.117:6808/4196478755 conn(0xbe6e20 0xc629e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f5cfc03d170 0x7f5cfc03f680 unknown :-1 s=CLOSED pgs=3794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 --2- 172.21.15.97:0/2444781356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xbe6300 0xc61f90 unknown :-1 s=CLOSED pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 >> 172.21.15.97:0/2444781356 conn(0xb0a770 msgr2=0xc7b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 shutdown_connections 2024-09-11T14:28:49.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.571+0000 7f5d1dc3dec0 1 -- 172.21.15.97:0/2444781356 wait complete. 2024-09-11T14:28:49.578 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:49.578 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj2 /etc/passwd 2024-09-11T14:28:49.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.622+0000 7fbbbf82bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.628+0000 7fbbbf82bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.628+0000 7fbbbf82bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.629+0000 7fbbbf82bec0 1 Processor -- start 2024-09-11T14:28:49.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.629+0000 7fbbbf82bec0 1 -- start start 2024-09-11T14:28:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.630+0000 7fbbbf82bec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x19b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.630+0000 7fbbbf82bec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1802520 con 0x1897e30 2024-09-11T14:28:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.630+0000 7fbbb2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x19b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.630+0000 7fbbb2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x19b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40418/0 (socket says 172.21.15.97:40418) 2024-09-11T14:28:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.630+0000 7fbbb2ffd640 1 -- 172.21.15.97:0/2299032074 learned_addr learned my addr 172.21.15.97:0/2299032074 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.631+0000 7fbbb2ffd640 1 -- 172.21.15.97:0/2299032074 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x179ee10 con 0x1897e30 2024-09-11T14:28:49.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.631+0000 7fbbb2ffd640 1 --2- 172.21.15.97:0/2299032074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x19b66c0 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1694162a4e268099 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.631+0000 7fbbb1ffb640 1 -- 172.21.15.97:0/2299032074 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbba402db90 con 0x1897e30 2024-09-11T14:28:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.631+0000 7fbbb1ffb640 1 -- 172.21.15.97:0/2299032074 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbba4037370 con 0x1897e30 2024-09-11T14:28:49.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.631+0000 7fbbb1ffb640 1 -- 172.21.15.97:0/2299032074 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbba40374e0 con 0x1897e30 2024-09-11T14:28:49.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.632+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/2299032074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 msgr2=0x19b66c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.632+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/2299032074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x19b66c0 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.632+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/2299032074 shutdown_connections 2024-09-11T14:28:49.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.632+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/2299032074 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x19b66c0 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.632+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/2299032074 >> 172.21.15.97:0/2299032074 conn(0x17c2770 msgr2=0x19b97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.632+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/2299032074 shutdown_connections 2024-09-11T14:28:49.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.632+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/2299032074 wait complete. 2024-09-11T14:28:49.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.633+0000 7fbbbf82bec0 1 Processor -- start 2024-09-11T14:28:49.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.633+0000 7fbbbf82bec0 1 -- start start 2024-09-11T14:28:49.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbbf82bec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x1929710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbbf82bec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1800280 con 0x1897e30 2024-09-11T14:28:49.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x1929710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x1929710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40424/0 (socket says 172.21.15.97:40424) 2024-09-11T14:28:49.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb2ffd640 1 -- 172.21.15.97:0/1551016239 learned_addr learned my addr 172.21.15.97:0/1551016239 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb2ffd640 1 -- 172.21.15.97:0/1551016239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1790920 con 0x1897e30 2024-09-11T14:28:49.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb2ffd640 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x1929710 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb0ff9640 1 -- 172.21.15.97:0/1551016239 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbba403e040 con 0x1897e30 2024-09-11T14:28:49.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb0ff9640 1 -- 172.21.15.97:0/1551016239 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbba40057c0 con 0x1897e30 2024-09-11T14:28:49.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1790380 con 0x1897e30 2024-09-11T14:28:49.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.634+0000 7fbbb0ff9640 1 -- 172.21.15.97:0/1551016239 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbba402db90 con 0x1897e30 2024-09-11T14:28:49.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.635+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x189b260 con 0x1897e30 2024-09-11T14:28:49.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.635+0000 7fbbb0ff9640 1 -- 172.21.15.97:0/1551016239 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbba4039450 con 0x1897e30 2024-09-11T14:28:49.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.636+0000 7fbbb0ff9640 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbb9403d170 0x7fbb9403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.636+0000 7fbbb0ff9640 1 -- 172.21.15.97:0/1551016239 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7fbba4032040 con 0x1897e30 2024-09-11T14:28:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.636+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/1551016239 >> v2:172.21.15.117:6808/4196478755 conn(0x1930df0 0x1899eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.636+0000 7fbbaa7fc640 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbb9403d170 0x7fbb9403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.636+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1919c10 con 0x1930df0 2024-09-11T14:28:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.636+0000 7fbbaa7fc640 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbb9403d170 0x7fbb9403f680 crc :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.637+0000 7fbbb37fe640 1 --2- 172.21.15.97:0/1551016239 >> v2:172.21.15.117:6808/4196478755 conn(0x1930df0 0x1899eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:49.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.643+0000 7fbbb37fe640 1 --2- 172.21.15.97:0/1551016239 >> v2:172.21.15.117:6808/4196478755 conn(0x1930df0 0x1899eb0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.656+0000 7fbbb37fe640 1 -- 172.21.15.97:0/1551016239 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 obj2 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbbac00a430 con 0x1930df0 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 >> v2:172.21.15.117:6808/4196478755 conn(0x1930df0 msgr2=0x1899eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/1551016239 >> v2:172.21.15.117:6808/4196478755 conn(0x1930df0 0x1899eb0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbb9403d170 msgr2=0x7fbb9403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbb9403d170 0x7fbb9403f680 crc :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 msgr2=0x1929710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x1929710 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 shutdown_connections 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/1551016239 >> v2:172.21.15.117:6808/4196478755 conn(0x1930df0 0x1899eb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fbb9403d170 0x7fbb9403f680 unknown :-1 s=CLOSED pgs=3795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 --2- 172.21.15.97:0/1551016239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1897e30 0x1929710 unknown :-1 s=CLOSED pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 >> 172.21.15.97:0/1551016239 conn(0x17c2770 msgr2=0x19b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 shutdown_connections 2024-09-11T14:28:49.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.657+0000 7fbbbf82bec0 1 -- 172.21.15.97:0/1551016239 wait complete. 2024-09-11T14:28:49.662 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:49.663 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj3 /etc/passwd 2024-09-11T14:28:49.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.696+0000 7fe600032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.701+0000 7fe600032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.701+0000 7fe600032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.702+0000 7fe600032ec0 1 Processor -- start 2024-09-11T14:28:49.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.702+0000 7fe600032ec0 1 -- start start 2024-09-11T14:28:49.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.703+0000 7fe600032ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x11886d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.703+0000 7fe600032ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xfd3520 con 0x1068e30 2024-09-11T14:28:49.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.703+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x11886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.703+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x11886d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40432/0 (socket says 172.21.15.97:40432) 2024-09-11T14:28:49.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.703+0000 7fe5f37fe640 1 -- 172.21.15.97:0/3598340863 learned_addr learned my addr 172.21.15.97:0/3598340863 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.703+0000 7fe5f37fe640 1 -- 172.21.15.97:0/3598340863 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf6fe10 con 0x1068e30 2024-09-11T14:28:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe5f37fe640 1 --2- 172.21.15.97:0/3598340863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x11886d0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d179ff1dfae67a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe5f27fc640 1 -- 172.21.15.97:0/3598340863 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e402dc90 con 0x1068e30 2024-09-11T14:28:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe5f27fc640 1 -- 172.21.15.97:0/3598340863 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe5e402de90 con 0x1068e30 2024-09-11T14:28:49.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe5f27fc640 1 -- 172.21.15.97:0/3598340863 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e400a170 con 0x1068e30 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe600032ec0 1 -- 172.21.15.97:0/3598340863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 msgr2=0x11886d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe600032ec0 1 --2- 172.21.15.97:0/3598340863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x11886d0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe600032ec0 1 -- 172.21.15.97:0/3598340863 shutdown_connections 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe600032ec0 1 --2- 172.21.15.97:0/3598340863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x11886d0 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe600032ec0 1 -- 172.21.15.97:0/3598340863 >> 172.21.15.97:0/3598340863 conn(0xf93770 msgr2=0x1071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe600032ec0 1 -- 172.21.15.97:0/3598340863 shutdown_connections 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.704+0000 7fe600032ec0 1 -- 172.21.15.97:0/3598340863 wait complete. 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.705+0000 7fe600032ec0 1 Processor -- start 2024-09-11T14:28:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.705+0000 7fe600032ec0 1 -- start start 2024-09-11T14:28:49.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.706+0000 7fe600032ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x106ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.706+0000 7fe600032ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xfd1280 con 0x1068e30 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.706+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x106ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.706+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x106ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40446/0 (socket says 172.21.15.97:40446) 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.706+0000 7fe5f37fe640 1 -- 172.21.15.97:0/4267890253 learned_addr learned my addr 172.21.15.97:0/4267890253 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.707+0000 7fe5f37fe640 1 -- 172.21.15.97:0/4267890253 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf61920 con 0x1068e30 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.707+0000 7fe5f37fe640 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x106ae00 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.707+0000 7fe5f17fa640 1 -- 172.21.15.97:0/4267890253 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e4009620 con 0x1068e30 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.707+0000 7fe5f17fa640 1 -- 172.21.15.97:0/4267890253 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe5e4009780 con 0x1068e30 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.707+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf61380 con 0x1068e30 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.707+0000 7fe5f17fa640 1 -- 172.21.15.97:0/4267890253 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e4009a20 con 0x1068e30 2024-09-11T14:28:49.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.707+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x106c150 con 0x1068e30 2024-09-11T14:28:49.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.708+0000 7fe5f17fa640 1 -- 172.21.15.97:0/4267890253 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe5e4009bd0 con 0x1068e30 2024-09-11T14:28:49.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.708+0000 7fe5f17fa640 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5d403d1c0 0x7fe5d403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.708+0000 7fe5f17fa640 1 -- 172.21.15.97:0/4267890253 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7fe5e4032040 con 0x1068e30 2024-09-11T14:28:49.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.708+0000 7fe600032ec0 1 --2- 172.21.15.97:0/4267890253 >> v2:172.21.15.97:6804/1629092190 conn(0x1101df0 0x1196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.708+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x106d5e0 con 0x1101df0 2024-09-11T14:28:49.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.709+0000 7fe5ebfff640 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5d403d1c0 0x7fe5d403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.709+0000 7fe5ebfff640 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5d403d1c0 0x7fe5d403f6d0 crc :-1 s=READY pgs=3796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.709+0000 7fe5f899c640 1 --2- 172.21.15.97:0/4267890253 >> v2:172.21.15.97:6804/1629092190 conn(0x1101df0 0x1196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:49.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.713+0000 7fe5f899c640 1 --2- 172.21.15.97:0/4267890253 >> v2:172.21.15.97:6804/1629092190 conn(0x1101df0 0x1196820 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe5f899c640 1 -- 172.21.15.97:0/4267890253 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== osd_op_reply(1 obj3 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe5ec00a430 con 0x1101df0 2024-09-11T14:28:49.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 >> v2:172.21.15.97:6804/1629092190 conn(0x1101df0 msgr2=0x1196820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 --2- 172.21.15.97:0/4267890253 >> v2:172.21.15.97:6804/1629092190 conn(0x1101df0 0x1196820 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5d403d1c0 msgr2=0x7fe5d403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5d403d1c0 0x7fe5d403f6d0 crc :-1 s=READY pgs=3796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 msgr2=0x106ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x106ae00 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 shutdown_connections 2024-09-11T14:28:49.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 --2- 172.21.15.97:0/4267890253 >> v2:172.21.15.97:6804/1629092190 conn(0x1101df0 0x1196820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5d403d1c0 0x7fe5d403f6d0 unknown :-1 s=CLOSED pgs=3796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 --2- 172.21.15.97:0/4267890253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1068e30 0x106ae00 unknown :-1 s=CLOSED pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 >> 172.21.15.97:0/4267890253 conn(0xf93770 msgr2=0x1071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 shutdown_connections 2024-09-11T14:28:49.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.726+0000 7fe600032ec0 1 -- 172.21.15.97:0/4267890253 wait complete. 2024-09-11T14:28:49.730 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:49.730 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj4 /etc/passwd 2024-09-11T14:28:49.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.765+0000 7f2f8d22bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.770+0000 7f2f8d22bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.770+0000 7f2f8d22bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.771+0000 7f2f8d22bec0 1 Processor -- start 2024-09-11T14:28:49.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.771+0000 7f2f8d22bec0 1 -- start start 2024-09-11T14:28:49.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f8d22bec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0xa20590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f8d22bec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x86c520 con 0x908300 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f8539b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0xa20590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f8539b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0xa20590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40460/0 (socket says 172.21.15.97:40460) 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f8539b640 1 -- 172.21.15.97:0/3781840147 learned_addr learned my addr 172.21.15.97:0/3781840147 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f8539b640 1 -- 172.21.15.97:0/3781840147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x808e10 con 0x908300 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f8539b640 1 --2- 172.21.15.97:0/3781840147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0xa20590 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8723cc5e6224155 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f7effd640 1 -- 172.21.15.97:0/3781840147 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f7002dc20 con 0x908300 2024-09-11T14:28:49.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f7effd640 1 -- 172.21.15.97:0/3781840147 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f70037370 con 0x908300 2024-09-11T14:28:49.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.772+0000 7f2f7effd640 1 -- 172.21.15.97:0/3781840147 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f70037610 con 0x908300 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.773+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/3781840147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 msgr2=0xa20590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.773+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/3781840147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0xa20590 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.773+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/3781840147 shutdown_connections 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.773+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/3781840147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0xa20590 unknown :-1 s=CLOSED pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.773+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/3781840147 >> 172.21.15.97:0/3781840147 conn(0x82c770 msgr2=0x90a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.773+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/3781840147 shutdown_connections 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.773+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/3781840147 wait complete. 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.774+0000 7f2f8d22bec0 1 Processor -- start 2024-09-11T14:28:49.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.774+0000 7f2f8d22bec0 1 -- start start 2024-09-11T14:28:49.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.775+0000 7f2f8d22bec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0x983f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.775+0000 7f2f8d22bec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x86a280 con 0x908300 2024-09-11T14:28:49.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.775+0000 7f2f8539b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0x983f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.775+0000 7f2f8539b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0x983f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40474/0 (socket says 172.21.15.97:40474) 2024-09-11T14:28:49.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.775+0000 7f2f8539b640 1 -- 172.21.15.97:0/1496330014 learned_addr learned my addr 172.21.15.97:0/1496330014 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.775+0000 7f2f8539b640 1 -- 172.21.15.97:0/1496330014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa920 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.775+0000 7f2f8539b640 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0x983f90 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.776+0000 7f2f7dffb640 1 -- 172.21.15.97:0/1496330014 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f70037610 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.776+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa380 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.776+0000 7f2f7dffb640 1 -- 172.21.15.97:0/1496330014 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f7002daf0 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.776+0000 7f2f7dffb640 1 -- 172.21.15.97:0/1496330014 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f70039450 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.776+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x985a00 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.777+0000 7f2f7dffb640 1 -- 172.21.15.97:0/1496330014 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2f70039650 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.777+0000 7f2f7dffb640 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2f6c03d170 0x7f2f6c03f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.777+0000 7f2f7dffb640 1 -- 172.21.15.97:0/1496330014 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7f2f70032040 con 0x908300 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.777+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/1496330014 >> v2:172.21.15.117:6808/4196478755 conn(0x99aa60 0x996ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.777+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x9870c0 con 0x99aa60 2024-09-11T14:28:49.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.777+0000 7f2f84b9a640 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2f6c03d170 0x7f2f6c03f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.778+0000 7f2f84b9a640 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2f6c03d170 0x7f2f6c03f680 crc :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.778+0000 7f2f85b9c640 1 --2- 172.21.15.97:0/1496330014 >> v2:172.21.15.117:6808/4196478755 conn(0x99aa60 0x996ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:49.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.782+0000 7f2f85b9c640 1 --2- 172.21.15.97:0/1496330014 >> v2:172.21.15.117:6808/4196478755 conn(0x99aa60 0x996ac0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f85b9c640 1 -- 172.21.15.97:0/1496330014 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 obj4 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2f7800a430 con 0x99aa60 2024-09-11T14:28:49.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 >> v2:172.21.15.117:6808/4196478755 conn(0x99aa60 msgr2=0x996ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/1496330014 >> v2:172.21.15.117:6808/4196478755 conn(0x99aa60 0x996ac0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2f6c03d170 msgr2=0x7f2f6c03f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2f6c03d170 0x7f2f6c03f680 crc :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 msgr2=0x983f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0x983f90 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 shutdown_connections 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/1496330014 >> v2:172.21.15.117:6808/4196478755 conn(0x99aa60 0x996ac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f2f6c03d170 0x7f2f6c03f680 unknown :-1 s=CLOSED pgs=3797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 --2- 172.21.15.97:0/1496330014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x908300 0x983f90 unknown :-1 s=CLOSED pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 >> 172.21.15.97:0/1496330014 conn(0x82c770 msgr2=0xa20590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 shutdown_connections 2024-09-11T14:28:49.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.795+0000 7f2f8d22bec0 1 -- 172.21.15.97:0/1496330014 wait complete. 2024-09-11T14:28:49.799 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:49.799 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj5 /etc/passwd 2024-09-11T14:28:49.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.833+0000 7fe0b862cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.838+0000 7fe0b862cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.838+0000 7fe0b862cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.838+0000 7fe0b862cec0 1 Processor -- start 2024-09-11T14:28:49.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.838+0000 7fe0b862cec0 1 -- start start 2024-09-11T14:28:49.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.839+0000 7fe0b862cec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xc67ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.839+0000 7fe0b862cec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xbc8520 con 0xcf69b0 2024-09-11T14:28:49.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.839+0000 7fe0ab7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xc67ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.839+0000 7fe0ab7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xc67ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40488/0 (socket says 172.21.15.97:40488) 2024-09-11T14:28:49.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.839+0000 7fe0ab7fe640 1 -- 172.21.15.97:0/1655856044 learned_addr learned my addr 172.21.15.97:0/1655856044 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.840+0000 7fe0ab7fe640 1 -- 172.21.15.97:0/1655856044 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb64e10 con 0xcf69b0 2024-09-11T14:28:49.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.840+0000 7fe0ab7fe640 1 --2- 172.21.15.97:0/1655856044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xc67ad0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0d6337d5a7b7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.840+0000 7fe0aa7fc640 1 -- 172.21.15.97:0/1655856044 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe09c02db60 con 0xcf69b0 2024-09-11T14:28:49.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.840+0000 7fe0aa7fc640 1 -- 172.21.15.97:0/1655856044 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe09c037370 con 0xcf69b0 2024-09-11T14:28:49.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.840+0000 7fe0aa7fc640 1 -- 172.21.15.97:0/1655856044 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe09c037610 con 0xcf69b0 2024-09-11T14:28:49.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 -- 172.21.15.97:0/1655856044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 msgr2=0xc67ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/1655856044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xc67ad0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 -- 172.21.15.97:0/1655856044 shutdown_connections 2024-09-11T14:28:49.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/1655856044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xc67ad0 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 -- 172.21.15.97:0/1655856044 >> 172.21.15.97:0/1655856044 conn(0xb88770 msgr2=0xc601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 -- 172.21.15.97:0/1655856044 shutdown_connections 2024-09-11T14:28:49.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 -- 172.21.15.97:0/1655856044 wait complete. 2024-09-11T14:28:49.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.841+0000 7fe0b862cec0 1 Processor -- start 2024-09-11T14:28:49.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.842+0000 7fe0b862cec0 1 -- start start 2024-09-11T14:28:49.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.842+0000 7fe0b862cec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xce1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.842+0000 7fe0b862cec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0xbc6280 con 0xcf69b0 2024-09-11T14:28:49.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0ab7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xce1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0ab7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xce1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40494/0 (socket says 172.21.15.97:40494) 2024-09-11T14:28:49.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0ab7fe640 1 -- 172.21.15.97:0/218143931 learned_addr learned my addr 172.21.15.97:0/218143931 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0ab7fe640 1 -- 172.21.15.97:0/218143931 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb56920 con 0xcf69b0 2024-09-11T14:28:49.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0ab7fe640 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xce1f90 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0a97fa640 1 -- 172.21.15.97:0/218143931 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe09c03f040 con 0xcf69b0 2024-09-11T14:28:49.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0a97fa640 1 -- 172.21.15.97:0/218143931 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe09c02da30 con 0xcf69b0 2024-09-11T14:28:49.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb56380 con 0xcf69b0 2024-09-11T14:28:49.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0a97fa640 1 -- 172.21.15.97:0/218143931 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe09c037610 con 0xcf69b0 2024-09-11T14:28:49.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.843+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd7fb70 con 0xcf69b0 2024-09-11T14:28:49.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.844+0000 7fe0a97fa640 1 -- 172.21.15.97:0/218143931 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe09c039450 con 0xcf69b0 2024-09-11T14:28:49.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.844+0000 7fe0a97fa640 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe08c03d1c0 0x7fe08c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.845+0000 7fe0a97fa640 1 -- 172.21.15.97:0/218143931 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7fe09c032040 con 0xcf69b0 2024-09-11T14:28:49.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.845+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/218143931 >> v2:172.21.15.117:6808/4196478755 conn(0xcf7300 0xcf5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.845+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0xcf6570 con 0xcf7300 2024-09-11T14:28:49.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.845+0000 7fe0a3fff640 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe08c03d1c0 0x7fe08c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.845+0000 7fe0a3fff640 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe08c03d1c0 0x7fe08c03f6d0 crc :-1 s=READY pgs=3798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.845+0000 7fe0b0f9c640 1 --2- 172.21.15.97:0/218143931 >> v2:172.21.15.117:6808/4196478755 conn(0xcf7300 0xcf5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:49.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.848+0000 7fe0b0f9c640 1 --2- 172.21.15.97:0/218143931 >> v2:172.21.15.117:6808/4196478755 conn(0xcf7300 0xcf5530 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b0f9c640 1 -- 172.21.15.97:0/218143931 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 obj5 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe0a400a430 con 0xcf7300 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 >> v2:172.21.15.117:6808/4196478755 conn(0xcf7300 msgr2=0xcf5530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/218143931 >> v2:172.21.15.117:6808/4196478755 conn(0xcf7300 0xcf5530 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe08c03d1c0 msgr2=0x7fe08c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe08c03d1c0 0x7fe08c03f6d0 crc :-1 s=READY pgs=3798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 msgr2=0xce1f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xce1f90 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 shutdown_connections 2024-09-11T14:28:49.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/218143931 >> v2:172.21.15.117:6808/4196478755 conn(0xcf7300 0xcf5530 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe08c03d1c0 0x7fe08c03f6d0 unknown :-1 s=CLOSED pgs=3798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 --2- 172.21.15.97:0/218143931 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0xcf69b0 0xce1f90 unknown :-1 s=CLOSED pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 >> 172.21.15.97:0/218143931 conn(0xb88770 msgr2=0xc61da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 shutdown_connections 2024-09-11T14:28:49.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.864+0000 7fe0b862cec0 1 -- 172.21.15.97:0/218143931 wait complete. 2024-09-11T14:28:49.868 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:49.868 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj6 /etc/passwd 2024-09-11T14:28:49.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.903+0000 7f8b9af1eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.908+0000 7f8b9af1eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.908+0000 7f8b9af1eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.909+0000 7f8b9af1eec0 1 Processor -- start 2024-09-11T14:28:49.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.909+0000 7f8b9af1eec0 1 -- start start 2024-09-11T14:28:49.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b9af1eec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1af48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b9af1eec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x193e520 con 0x1a6c9b0 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b9339b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1af48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b9339b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1af48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40510/0 (socket says 172.21.15.97:40510) 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b9339b640 1 -- 172.21.15.97:0/608433961 learned_addr learned my addr 172.21.15.97:0/608433961 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b9339b640 1 -- 172.21.15.97:0/608433961 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18dae10 con 0x1a6c9b0 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b9339b640 1 --2- 172.21.15.97:0/608433961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1af48f0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10e79f7b69c3e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b91b98640 1 -- 172.21.15.97:0/608433961 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b7c00c490 con 0x1a6c9b0 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b91b98640 1 -- 172.21.15.97:0/608433961 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8b7c00c5f0 con 0x1a6c9b0 2024-09-11T14:28:49.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.910+0000 7f8b91b98640 1 -- 172.21.15.97:0/608433961 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b7c00c890 con 0x1a6c9b0 2024-09-11T14:28:49.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.911+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/608433961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 msgr2=0x1af48f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.911+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/608433961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1af48f0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.911+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/608433961 shutdown_connections 2024-09-11T14:28:49.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.911+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/608433961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1af48f0 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.911+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/608433961 >> 172.21.15.97:0/608433961 conn(0x18fe770 msgr2=0x19d72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.911+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/608433961 shutdown_connections 2024-09-11T14:28:49.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.911+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/608433961 wait complete. 2024-09-11T14:28:49.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.912+0000 7f8b9af1eec0 1 Processor -- start 2024-09-11T14:28:49.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.912+0000 7f8b9af1eec0 1 -- start start 2024-09-11T14:28:49.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9af1eec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1b01880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9af1eec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x193c280 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9339b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1b01880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9339b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1b01880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40524/0 (socket says 172.21.15.97:40524) 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9339b640 1 -- 172.21.15.97:0/1293157420 learned_addr learned my addr 172.21.15.97:0/1293157420 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9339b640 1 -- 172.21.15.97:0/1293157420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18cc920 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9339b640 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1b01880 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b90b96640 1 -- 172.21.15.97:0/1293157420 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b7c0110b0 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b90b96640 1 -- 172.21.15.97:0/1293157420 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8b7c011210 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x18cc380 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b90b96640 1 -- 172.21.15.97:0/1293157420 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b7c011a80 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.913+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a6c520 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.914+0000 7f8b90b96640 1 -- 172.21.15.97:0/1293157420 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8b7c011c80 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.915+0000 7f8b90b96640 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f8b7803d170 0x7f8b7803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.915+0000 7f8b90b96640 1 -- 172.21.15.97:0/1293157420 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7f8b7c0502b0 con 0x1a6c9b0 2024-09-11T14:28:49.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.915+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/1293157420 >> v2:172.21.15.97:6804/1629092190 conn(0x1a6d4d0 0x1a6b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.915+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 --> v2:172.21.15.97:6804/1629092190 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1a5baf0 con 0x1a6d4d0 2024-09-11T14:28:49.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.915+0000 7f8b92b9a640 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f8b7803d170 0x7f8b7803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.915+0000 7f8b92b9a640 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f8b7803d170 0x7f8b7803f680 crc :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.915+0000 7f8b93b9c640 1 --2- 172.21.15.97:0/1293157420 >> v2:172.21.15.97:6804/1629092190 conn(0x1a6d4d0 0x1a6b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:49.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.918+0000 7f8b93b9c640 1 --2- 172.21.15.97:0/1293157420 >> v2:172.21.15.97:6804/1629092190 conn(0x1a6d4d0 0x1a6b460 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.931+0000 7f8b93b9c640 1 -- 172.21.15.97:0/1293157420 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== osd_op_reply(1 obj6 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8b8400a430 con 0x1a6d4d0 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.931+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 >> v2:172.21.15.97:6804/1629092190 conn(0x1a6d4d0 msgr2=0x1a6b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.931+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/1293157420 >> v2:172.21.15.97:6804/1629092190 conn(0x1a6d4d0 0x1a6b460 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.931+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f8b7803d170 msgr2=0x7f8b7803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.931+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f8b7803d170 0x7f8b7803f680 crc :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.931+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 msgr2=0x1b01880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.931+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1b01880 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.932+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 shutdown_connections 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.932+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/1293157420 >> v2:172.21.15.97:6804/1629092190 conn(0x1a6d4d0 0x1a6b460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.932+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f8b7803d170 0x7f8b7803f680 unknown :-1 s=CLOSED pgs=3799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.932+0000 7f8b9af1eec0 1 --2- 172.21.15.97:0/1293157420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a6c9b0 0x1b01880 unknown :-1 s=CLOSED pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.932+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 >> 172.21.15.97:0/1293157420 conn(0x18fe770 msgr2=0x19d72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.932+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 shutdown_connections 2024-09-11T14:28:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.932+0000 7f8b9af1eec0 1 -- 172.21.15.97:0/1293157420 wait complete. 2024-09-11T14:28:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj7 /etc/passwd 2024-09-11T14:28:49.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.971+0000 7f1599110ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.976+0000 7f1599110ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.976+0000 7f1599110ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:49.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.976+0000 7f1599110ec0 1 Processor -- start 2024-09-11T14:28:49.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.976+0000 7f1599110ec0 1 -- start start 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.977+0000 7f1599110ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x739590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.977+0000 7f1599110ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x585520 con 0x621300 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f159143f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x739590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f159143f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x739590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40542/0 (socket says 172.21.15.97:40542) 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f159143f640 1 -- 172.21.15.97:0/2049349467 learned_addr learned my addr 172.21.15.97:0/2049349467 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f159143f640 1 -- 172.21.15.97:0/2049349467 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x521e10 con 0x621300 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f159143f640 1 --2- 172.21.15.97:0/2049349467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x739590 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4fe6d5f03aaad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f158affd640 1 -- 172.21.15.97:0/2049349467 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f157c00a040 con 0x621300 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f158affd640 1 -- 172.21.15.97:0/2049349467 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f157c00a1a0 con 0x621300 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.978+0000 7f158affd640 1 -- 172.21.15.97:0/2049349467 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f157c009410 con 0x621300 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 -- 172.21.15.97:0/2049349467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 msgr2=0x739590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 --2- 172.21.15.97:0/2049349467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x739590 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 -- 172.21.15.97:0/2049349467 shutdown_connections 2024-09-11T14:28:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 --2- 172.21.15.97:0/2049349467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x739590 unknown :-1 s=CLOSED pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 -- 172.21.15.97:0/2049349467 >> 172.21.15.97:0/2049349467 conn(0x545770 msgr2=0x6236f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 -- 172.21.15.97:0/2049349467 shutdown_connections 2024-09-11T14:28:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 -- 172.21.15.97:0/2049349467 wait complete. 2024-09-11T14:28:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.979+0000 7f1599110ec0 1 Processor -- start 2024-09-11T14:28:49.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.980+0000 7f1599110ec0 1 -- start start 2024-09-11T14:28:49.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f1599110ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x7484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f1599110ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x583280 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f159143f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x7484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f159143f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x7484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40554/0 (socket says 172.21.15.97:40554) 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f159143f640 1 -- 172.21.15.97:0/1555379685 learned_addr learned my addr 172.21.15.97:0/1555379685 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f159143f640 1 -- 172.21.15.97:0/1555379685 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x513920 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f159143f640 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x7484f0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f1589ffb640 1 -- 172.21.15.97:0/1555379685 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f157c00a310 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f1589ffb640 1 -- 172.21.15.97:0/1555379685 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f157c009dc0 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x513380 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f1589ffb640 1 -- 172.21.15.97:0/1555379685 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f157c02dbf0 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.981+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x6b0c00 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.982+0000 7f1589ffb640 1 -- 172.21.15.97:0/1555379685 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f157c039450 con 0x621300 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.982+0000 7f1589ffb640 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f157803d1c0 0x7f157803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.982+0000 7f1589ffb640 1 -- 172.21.15.97:0/1555379685 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7f157c040040 con 0x621300 2024-09-11T14:28:49.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.983+0000 7f1590c3e640 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f157803d1c0 0x7f157803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:49.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.983+0000 7f1599110ec0 1 --2- 172.21.15.97:0/1555379685 >> v2:172.21.15.97:6801/2470268139 conn(0x6b3a60 0x6afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:49.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.983+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x6a01d0 con 0x6b3a60 2024-09-11T14:28:49.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.983+0000 7f1590c3e640 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f157803d1c0 0x7f157803f6d0 crc :-1 s=READY pgs=3800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:49.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.984+0000 7f1591c40640 1 --2- 172.21.15.97:0/1555379685 >> v2:172.21.15.97:6801/2470268139 conn(0x6b3a60 0x6afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:49.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:49.987+0000 7f1591c40640 1 --2- 172.21.15.97:0/1555379685 >> v2:172.21.15.97:6801/2470268139 conn(0x6b3a60 0x6afb60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1591c40640 1 -- 172.21.15.97:0/1555379685 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj7 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f158400a430 con 0x6b3a60 2024-09-11T14:28:50.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 >> v2:172.21.15.97:6801/2470268139 conn(0x6b3a60 msgr2=0x6afb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 --2- 172.21.15.97:0/1555379685 >> v2:172.21.15.97:6801/2470268139 conn(0x6b3a60 0x6afb60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f157803d1c0 msgr2=0x7f157803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f157803d1c0 0x7f157803f6d0 crc :-1 s=READY pgs=3800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 msgr2=0x7484f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x7484f0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 shutdown_connections 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 --2- 172.21.15.97:0/1555379685 >> v2:172.21.15.97:6801/2470268139 conn(0x6b3a60 0x6afb60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f157803d1c0 0x7f157803f6d0 unknown :-1 s=CLOSED pgs=3800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 --2- 172.21.15.97:0/1555379685 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x621300 0x7484f0 unknown :-1 s=CLOSED pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 >> 172.21.15.97:0/1555379685 conn(0x545770 msgr2=0x6236f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 shutdown_connections 2024-09-11T14:28:50.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.000+0000 7f1599110ec0 1 -- 172.21.15.97:0/1555379685 wait complete. 2024-09-11T14:28:50.005 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:50.005 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj8 /etc/passwd 2024-09-11T14:28:50.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.039+0000 7fe5fdd41ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.044+0000 7fe5fdd41ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.045+0000 7fe5fdd41ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.045+0000 7fe5fdd41ec0 1 Processor -- start 2024-09-11T14:28:50.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.045+0000 7fe5fdd41ec0 1 -- start start 2024-09-11T14:28:50.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.046+0000 7fe5fdd41ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1f9cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.046+0000 7fe5fdd41ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1de2520 con 0x1e75fc0 2024-09-11T14:28:50.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.046+0000 7fe5f619b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1f9cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.046+0000 7fe5f619b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1f9cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40576/0 (socket says 172.21.15.97:40576) 2024-09-11T14:28:50.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.046+0000 7fe5f619b640 1 -- 172.21.15.97:0/1139343182 learned_addr learned my addr 172.21.15.97:0/1139343182 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:50.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.047+0000 7fe5f619b640 1 -- 172.21.15.97:0/1139343182 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d7ee10 con 0x1e75fc0 2024-09-11T14:28:50.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.047+0000 7fe5f619b640 1 --2- 172.21.15.97:0/1139343182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1f9cc60 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55ce82dd7ad1c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.047+0000 7fe5f4998640 1 -- 172.21.15.97:0/1139343182 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e002dcc0 con 0x1e75fc0 2024-09-11T14:28:50.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.047+0000 7fe5f4998640 1 -- 172.21.15.97:0/1139343182 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe5e0035420 con 0x1e75fc0 2024-09-11T14:28:50.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.047+0000 7fe5f4998640 1 -- 172.21.15.97:0/1139343182 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e00356c0 con 0x1e75fc0 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1139343182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 msgr2=0x1f9cc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1139343182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1f9cc60 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1139343182 shutdown_connections 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1139343182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1f9cc60 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1139343182 >> 172.21.15.97:0/1139343182 conn(0x1da2770 msgr2=0x1e77700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1139343182 shutdown_connections 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1139343182 wait complete. 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 Processor -- start 2024-09-11T14:28:50.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.048+0000 7fe5fdd41ec0 1 -- start start 2024-09-11T14:28:50.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.049+0000 7fe5fdd41ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1fa3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.049+0000 7fe5fdd41ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1de0280 con 0x1e75fc0 2024-09-11T14:28:50.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.049+0000 7fe5f619b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1fa3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5f619b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1fa3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40584/0 (socket says 172.21.15.97:40584) 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5f619b640 1 -- 172.21.15.97:0/1319872953 learned_addr learned my addr 172.21.15.97:0/1319872953 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5f619b640 1 -- 172.21.15.97:0/1319872953 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d70920 con 0x1e75fc0 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5f619b640 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1fa3400 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5eeffd640 1 -- 172.21.15.97:0/1319872953 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e002db90 con 0x1e75fc0 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5eeffd640 1 -- 172.21.15.97:0/1319872953 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe5e0035cf0 con 0x1e75fc0 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1d70380 con 0x1e75fc0 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5eeffd640 1 -- 172.21.15.97:0/1319872953 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5e0035e60 con 0x1e75fc0 2024-09-11T14:28:50.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.050+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1f802e0 con 0x1e75fc0 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.051+0000 7fe5eeffd640 1 -- 172.21.15.97:0/1319872953 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe5e003e040 con 0x1e75fc0 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.051+0000 7fe5eeffd640 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5dc03d1c0 0x7fe5dc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.051+0000 7fe5eeffd640 1 -- 172.21.15.97:0/1319872953 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7fe5e003b040 con 0x1e75fc0 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.052+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1319872953 >> v2:172.21.15.97:6801/2470268139 conn(0x1e7e130 0x1f99480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.052+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1f83220 con 0x1e7e130 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.052+0000 7fe5f599a640 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5dc03d1c0 0x7fe5dc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.052+0000 7fe5f699c640 1 --2- 172.21.15.97:0/1319872953 >> v2:172.21.15.97:6801/2470268139 conn(0x1e7e130 0x1f99480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:50.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.052+0000 7fe5f599a640 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5dc03d1c0 0x7fe5dc03f6d0 crc :-1 s=READY pgs=3801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.055+0000 7fe5f699c640 1 --2- 172.21.15.97:0/1319872953 >> v2:172.21.15.97:6801/2470268139 conn(0x1e7e130 0x1f99480 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5f699c640 1 -- 172.21.15.97:0/1319872953 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj8 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe5e800a430 con 0x1e7e130 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 >> v2:172.21.15.97:6801/2470268139 conn(0x1e7e130 msgr2=0x1f99480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1319872953 >> v2:172.21.15.97:6801/2470268139 conn(0x1e7e130 0x1f99480 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5dc03d1c0 msgr2=0x7fe5dc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5dc03d1c0 0x7fe5dc03f6d0 crc :-1 s=READY pgs=3801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 msgr2=0x1fa3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1fa3400 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 shutdown_connections 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1319872953 >> v2:172.21.15.97:6801/2470268139 conn(0x1e7e130 0x1f99480 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fe5dc03d1c0 0x7fe5dc03f6d0 unknown :-1 s=CLOSED pgs=3801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 --2- 172.21.15.97:0/1319872953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1e75fc0 0x1fa3400 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 >> 172.21.15.97:0/1319872953 conn(0x1da2770 msgr2=0x1e79670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:50.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 shutdown_connections 2024-09-11T14:28:50.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.068+0000 7fe5fdd41ec0 1 -- 172.21.15.97:0/1319872953 wait complete. 2024-09-11T14:28:50.072 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:50.072 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj9 /etc/passwd 2024-09-11T14:28:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.107+0000 7f561a42cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.112+0000 7f561a42cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.112+0000 7f561a42cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.113+0000 7f561a42cec0 1 Processor -- start 2024-09-11T14:28:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.113+0000 7f561a42cec0 1 -- start start 2024-09-11T14:28:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f561a42cec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x248f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f561a42cec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x22db520 con 0x2370e30 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f561243f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x248f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f561243f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x248f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40612/0 (socket says 172.21.15.97:40612) 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f561243f640 1 -- 172.21.15.97:0/4057757771 learned_addr learned my addr 172.21.15.97:0/4057757771 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f561243f640 1 -- 172.21.15.97:0/4057757771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2277e10 con 0x2370e30 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f561243f640 1 --2- 172.21.15.97:0/4057757771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x248f6c0 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf272a3eebf3d830 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f5610c3c640 1 -- 172.21.15.97:0/4057757771 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55fc02dcc0 con 0x2370e30 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f5610c3c640 1 -- 172.21.15.97:0/4057757771 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f55fc037370 con 0x2370e30 2024-09-11T14:28:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.114+0000 7f5610c3c640 1 -- 172.21.15.97:0/4057757771 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55fc037610 con 0x2370e30 2024-09-11T14:28:50.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.115+0000 7f561a42cec0 1 -- 172.21.15.97:0/4057757771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 msgr2=0x248f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.115+0000 7f561a42cec0 1 --2- 172.21.15.97:0/4057757771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x248f6c0 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.115+0000 7f561a42cec0 1 -- 172.21.15.97:0/4057757771 shutdown_connections 2024-09-11T14:28:50.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.115+0000 7f561a42cec0 1 --2- 172.21.15.97:0/4057757771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x248f6c0 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.115+0000 7f561a42cec0 1 -- 172.21.15.97:0/4057757771 >> 172.21.15.97:0/4057757771 conn(0x229b770 msgr2=0x24927d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:50.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.115+0000 7f561a42cec0 1 -- 172.21.15.97:0/4057757771 shutdown_connections 2024-09-11T14:28:50.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.115+0000 7f561a42cec0 1 -- 172.21.15.97:0/4057757771 wait complete. 2024-09-11T14:28:50.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.116+0000 7f561a42cec0 1 Processor -- start 2024-09-11T14:28:50.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.116+0000 7f561a42cec0 1 -- start start 2024-09-11T14:28:50.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561a42cec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x249e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561a42cec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x22d9280 con 0x2370e30 2024-09-11T14:28:50.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561243f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x249e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561243f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x249e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40620/0 (socket says 172.21.15.97:40620) 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561243f640 1 -- 172.21.15.97:0/3557559212 learned_addr learned my addr 172.21.15.97:0/3557559212 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561243f640 1 -- 172.21.15.97:0/3557559212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2269920 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561243f640 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x249e9c0 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f560affd640 1 -- 172.21.15.97:0/3557559212 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55fc03e040 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f560affd640 1 -- 172.21.15.97:0/3557559212 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f55fc037bb0 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2269380 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f560affd640 1 -- 172.21.15.97:0/3557559212 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55fc02dcc0 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.117+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2374580 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.118+0000 7f560affd640 1 -- 172.21.15.97:0/3557559212 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f55fc041040 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.118+0000 7f560affd640 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f55f803d1c0 0x7f55f803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.119+0000 7f560affd640 1 -- 172.21.15.97:0/3557559212 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7f55fc032040 con 0x2370e30 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.119+0000 7f561a42cec0 1 --2- 172.21.15.97:0/3557559212 >> v2:172.21.15.117:6808/4196478755 conn(0x2409df0 0x23735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.119+0000 7f5611c3e640 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f55f803d1c0 0x7f55f803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.119+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 --> v2:172.21.15.117:6808/4196478755 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x23f2530 con 0x2409df0 2024-09-11T14:28:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.119+0000 7f5611c3e640 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f55f803d1c0 0x7f55f803f6d0 crc :-1 s=READY pgs=3802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.120+0000 7f5612c40640 1 --2- 172.21.15.97:0/3557559212 >> v2:172.21.15.117:6808/4196478755 conn(0x2409df0 0x23735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:50.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.123+0000 7f5612c40640 1 --2- 172.21.15.97:0/3557559212 >> v2:172.21.15.117:6808/4196478755 conn(0x2409df0 0x23735f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f5612c40640 1 -- 172.21.15.97:0/3557559212 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== osd_op_reply(1 obj9 [writefull 0~12777] v712'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f560400a430 con 0x2409df0 2024-09-11T14:28:50.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 >> v2:172.21.15.117:6808/4196478755 conn(0x2409df0 msgr2=0x23735f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 --2- 172.21.15.97:0/3557559212 >> v2:172.21.15.117:6808/4196478755 conn(0x2409df0 0x23735f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f55f803d1c0 msgr2=0x7f55f803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f55f803d1c0 0x7f55f803f6d0 crc :-1 s=READY pgs=3802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 msgr2=0x249e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x249e9c0 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 shutdown_connections 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 --2- 172.21.15.97:0/3557559212 >> v2:172.21.15.117:6808/4196478755 conn(0x2409df0 0x23735f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f55f803d1c0 0x7f55f803f6d0 unknown :-1 s=CLOSED pgs=3802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 --2- 172.21.15.97:0/3557559212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2370e30 0x249e9c0 unknown :-1 s=CLOSED pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 >> 172.21.15.97:0/3557559212 conn(0x229b770 msgr2=0x2492580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:50.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 shutdown_connections 2024-09-11T14:28:50.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.136+0000 7f561a42cec0 1 -- 172.21.15.97:0/3557559212 wait complete. 2024-09-11T14:28:50.140 INFO:tasks.workunit.client.0.smithi097.stderr:+ for f in `seq 1 10` 2024-09-11T14:28:50.140 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 put obj10 /etc/passwd 2024-09-11T14:28:50.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.175+0000 7f66a58fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.180+0000 7f66a58fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.180+0000 7f66a58fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:28:50.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.180+0000 7f66a58fdec0 1 Processor -- start 2024-09-11T14:28:50.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.181+0000 7f66a58fdec0 1 -- start start 2024-09-11T14:28:50.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.181+0000 7f66a58fdec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x19b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.181+0000 7f66a58fdec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1912520 con 0x1a409b0 2024-09-11T14:28:50.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f669dc3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x19b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f669dc3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x19b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40640/0 (socket says 172.21.15.97:40640) 2024-09-11T14:28:50.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f669dc3f640 1 -- 172.21.15.97:0/4194256444 learned_addr learned my addr 172.21.15.97:0/4194256444 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:50.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f669dc3f640 1 -- 172.21.15.97:0/4194256444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18aee10 con 0x1a409b0 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f669dc3f640 1 --2- 172.21.15.97:0/4194256444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x19b19b0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8a972b576cbb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f66977fe640 1 -- 172.21.15.97:0/4194256444 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f668800b580 con 0x1a409b0 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f66977fe640 1 -- 172.21.15.97:0/4194256444 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f668800b6e0 con 0x1a409b0 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.182+0000 7f66977fe640 1 -- 172.21.15.97:0/4194256444 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f668800b980 con 0x1a409b0 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.183+0000 7f66a58fdec0 1 -- 172.21.15.97:0/4194256444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 msgr2=0x19b19b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.183+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/4194256444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x19b19b0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.183+0000 7f66a58fdec0 1 -- 172.21.15.97:0/4194256444 shutdown_connections 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.183+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/4194256444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x19b19b0 unknown :-1 s=CLOSED pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.183+0000 7f66a58fdec0 1 -- 172.21.15.97:0/4194256444 >> 172.21.15.97:0/4194256444 conn(0x18d2770 msgr2=0x19a9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.183+0000 7f66a58fdec0 1 -- 172.21.15.97:0/4194256444 shutdown_connections 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.183+0000 7f66a58fdec0 1 -- 172.21.15.97:0/4194256444 wait complete. 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.184+0000 7f66a58fdec0 1 Processor -- start 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.184+0000 7f66a58fdec0 1 -- start start 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f66a58fdec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x1ad5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f66a58fdec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1910280 con 0x1a409b0 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f669dc3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x1ad5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f669dc3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x1ad5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40648/0 (socket says 172.21.15.97:40648) 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f669dc3f640 1 -- 172.21.15.97:0/3157656469 learned_addr learned my addr 172.21.15.97:0/3157656469 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:28:50.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f669dc3f640 1 -- 172.21.15.97:0/3157656469 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18a0920 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f669dc3f640 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x1ad5500 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f66967fc640 1 -- 172.21.15.97:0/3157656469 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66880129e0 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f66967fc640 1 -- 172.21.15.97:0/3157656469 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6688005040 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x18a0380 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f66967fc640 1 -- 172.21.15.97:0/3157656469 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6688012c70 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.185+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a2c640 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.186+0000 7f66967fc640 1 -- 172.21.15.97:0/3157656469 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f668800d040 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.186+0000 7f66967fc640 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f668403d170 0x7f668403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.187+0000 7f66967fc640 1 -- 172.21.15.97:0/3157656469 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(712..712 src has 397..712) ==== 4207+0+0 (crc 0 0 0) 0x7f668800a040 con 0x1a409b0 2024-09-11T14:28:50.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.187+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/3157656469 >> v2:172.21.15.97:6801/2470268139 conn(0x1a414d0 0x1a3f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:28:50.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.187+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 --> v2:172.21.15.97:6801/2470268139 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1a2fae0 con 0x1a414d0 2024-09-11T14:28:50.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.187+0000 7f669d43e640 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f668403d170 0x7f668403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:28:50.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.187+0000 7f669d43e640 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f668403d170 0x7f668403f680 crc :-1 s=READY pgs=3803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.188+0000 7f669e440640 1 --2- 172.21.15.97:0/3157656469 >> v2:172.21.15.97:6801/2470268139 conn(0x1a414d0 0x1a3f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:28:50.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.191+0000 7f669e440640 1 --2- 172.21.15.97:0/3157656469 >> v2:172.21.15.97:6801/2470268139 conn(0x1a414d0 0x1a3f600 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:28:50.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f669e440640 1 -- 172.21.15.97:0/3157656469 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== osd_op_reply(1 obj10 [writefull 0~12777] v712'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f669000a430 con 0x1a414d0 2024-09-11T14:28:50.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 >> v2:172.21.15.97:6801/2470268139 conn(0x1a414d0 msgr2=0x1a3f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/3157656469 >> v2:172.21.15.97:6801/2470268139 conn(0x1a414d0 0x1a3f600 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f668403d170 msgr2=0x7f668403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f668403d170 0x7f668403f680 crc :-1 s=READY pgs=3803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 msgr2=0x1ad5500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:28:50.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x1ad5500 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 shutdown_connections 2024-09-11T14:28:50.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/3157656469 >> v2:172.21.15.97:6801/2470268139 conn(0x1a414d0 0x1a3f600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f668403d170 0x7f668403f680 unknown :-1 s=CLOSED pgs=3803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 --2- 172.21.15.97:0/3157656469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a409b0 0x1ad5500 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:28:50.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 >> 172.21.15.97:0/3157656469 conn(0x18d2770 msgr2=0x19a9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:28:50.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 shutdown_connections 2024-09-11T14:28:50.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:28:50.204+0000 7f66a58fdec0 1 -- 172.21.15.97:0/3157656469 wait complete. 2024-09-11T14:28:50.211 INFO:tasks.workunit.client.0.smithi097.stderr:+ sleep 30 2024-09-11T14:29:20.211 INFO:tasks.workunit.client.0.smithi097.stderr:+ rados -p f2397458-472b-40b3-b6c8-73884edb56f3 put threemore /etc/passwd 2024-09-11T14:29:20.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.251+0000 7f0b9b639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:20.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.256+0000 7f0b9b639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:20.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.257+0000 7f0b9b639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:20.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.257+0000 7f0b9b639ec0 1 Processor -- start 2024-09-11T14:29:20.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.257+0000 7f0b9b639ec0 1 -- start start 2024-09-11T14:29:20.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.258+0000 7f0b9b639ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x19ee800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:20.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.258+0000 7f0b9b639ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1953520 con 0x1a7d3a0 2024-09-11T14:29:20.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.258+0000 7f0b9363f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x19ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:20.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.258+0000 7f0b9363f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x19ee800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46174/0 (socket says 172.21.15.97:46174) 2024-09-11T14:29:20.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.258+0000 7f0b9363f640 1 -- 172.21.15.97:0/4216528751 learned_addr learned my addr 172.21.15.97:0/4216528751 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:20.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.259+0000 7f0b9363f640 1 -- 172.21.15.97:0/4216528751 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18efe10 con 0x1a7d3a0 2024-09-11T14:29:20.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.259+0000 7f0b9363f640 1 --2- 172.21.15.97:0/4216528751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x19ee800 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65092bea66211f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:20.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.259+0000 7f0b91e3c640 1 -- 172.21.15.97:0/4216528751 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b7c0061e0 con 0x1a7d3a0 2024-09-11T14:29:20.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.259+0000 7f0b91e3c640 1 -- 172.21.15.97:0/4216528751 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b7c006340 con 0x1a7d3a0 2024-09-11T14:29:20.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.259+0000 7f0b91e3c640 1 -- 172.21.15.97:0/4216528751 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b7c001b00 con 0x1a7d3a0 2024-09-11T14:29:20.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.260+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/4216528751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 msgr2=0x19ee800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:20.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.260+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/4216528751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x19ee800 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.260+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/4216528751 shutdown_connections 2024-09-11T14:29:20.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.260+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/4216528751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x19ee800 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.260+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/4216528751 >> 172.21.15.97:0/4216528751 conn(0x1913770 msgr2=0x19f1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:20.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.260+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/4216528751 shutdown_connections 2024-09-11T14:29:20.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.260+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/4216528751 wait complete. 2024-09-11T14:29:20.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.261+0000 7f0b9b639ec0 1 Processor -- start 2024-09-11T14:29:20.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.261+0000 7f0b9b639ec0 1 -- start start 2024-09-11T14:29:20.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9b639ec0 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x1a69bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:20.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9b639ec0 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x1951280 con 0x1a7d3a0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9363f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x1a69bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9363f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x1a69bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46180/0 (socket says 172.21.15.97:46180) 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9363f640 1 -- 172.21.15.97:0/3004616216 learned_addr learned my addr 172.21.15.97:0/3004616216 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9363f640 1 -- 172.21.15.97:0/3004616216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18e1920 con 0x1a7d3a0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9363f640 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x1a69bc0 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b90e3a640 1 -- 172.21.15.97:0/3004616216 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b7c0049e0 con 0x1a7d3a0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x18e1380 con 0x1a7d3a0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b90e3a640 1 -- 172.21.15.97:0/3004616216 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b7c004b40 con 0x1a7d3a0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b90e3a640 1 -- 172.21.15.97:0/3004616216 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b7c004de0 con 0x1a7d3a0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.262+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a80880 con 0x1a7d3a0 2024-09-11T14:29:20.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.263+0000 7f0b90e3a640 1 -- 172.21.15.97:0/3004616216 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0b7c014410 con 0x1a7d3a0 2024-09-11T14:29:20.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.264+0000 7f0b90e3a640 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0b7803d170 0x7f0b7803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:20.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.264+0000 7f0b90e3a640 1 -- 172.21.15.97:0/3004616216 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(714..714 src has 397..714) ==== 4207+0+0 (crc 0 0 0) 0x7f0b7c04fcf0 con 0x1a7d3a0 2024-09-11T14:29:20.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.264+0000 7f0b90e3a640 1 -- 172.21.15.97:0/3004616216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f0b78043ba0 con 0x1a7d3a0 2024-09-11T14:29:20.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.264+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/3004616216 >> v2:172.21.15.117:6811/2173725438 conn(0x1a83840 0x1b16a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:20.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.264+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 --> v2:172.21.15.117:6811/2173725438 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e714) -- 0x1a6c9f0 con 0x1a83840 2024-09-11T14:29:20.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.264+0000 7f0b92e3e640 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0b7803d170 0x7f0b7803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:20.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.265+0000 7f0b92e3e640 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0b7803d170 0x7f0b7803f680 crc :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:20.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.265+0000 7f0b93e40640 1 --2- 172.21.15.97:0/3004616216 >> v2:172.21.15.117:6811/2173725438 conn(0x1a83840 0x1b16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:29:20.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.268+0000 7f0b93e40640 1 --2- 172.21.15.97:0/3004616216 >> v2:172.21.15.117:6811/2173725438 conn(0x1a83840 0x1b16a40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b93e40640 1 -- 172.21.15.97:0/3004616216 <== osd.2 v2:172.21.15.117:6811/2173725438 1 ==== osd_op_reply(1 threemore [writefull 0~12777] v714'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f0b8400c430 con 0x1a83840 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 >> v2:172.21.15.117:6811/2173725438 conn(0x1a83840 msgr2=0x1b16a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/3004616216 >> v2:172.21.15.117:6811/2173725438 conn(0x1a83840 0x1b16a40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0b7803d170 msgr2=0x7f0b7803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0b7803d170 0x7f0b7803f680 crc :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 msgr2=0x1a69bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x1a69bc0 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 shutdown_connections 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/3004616216 >> v2:172.21.15.117:6811/2173725438 conn(0x1a83840 0x1b16a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f0b7803d170 0x7f0b7803f680 unknown :-1 s=CLOSED pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 --2- 172.21.15.97:0/3004616216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x1a7d3a0 0x1a69bc0 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 >> 172.21.15.97:0/3004616216 conn(0x1913770 msgr2=0x19f3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:20.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 shutdown_connections 2024-09-11T14:29:20.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.286+0000 7f0b9b639ec0 1 -- 172.21.15.97:0/3004616216 wait complete. 2024-09-11T14:29:20.290 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota f2397458-472b-40b3-b6c8-73884edb56f3 max_bytes 0 2024-09-11T14:29:20.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.376+0000 7f1d22c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:20.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.385+0000 7f1d22c6c640 1 Processor -- start 2024-09-11T14:29:20.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.386+0000 7f1d22c6c640 1 -- start start 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d22c6c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d1c09c830 0x7f1d1c09cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d22c6c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1c06ea50 con 0x7f1d1c1322c0 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d22c6c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1c09d6e0 con 0x7f1d1c09c830 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d20a08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d1c09c830 0x7f1d1c09cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d20a08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d1c09c830 0x7f1d1c09cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46182/0 (socket says 172.21.15.97:46182) 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d20a08640 1 -- 172.21.15.97:0/1042095220 learned_addr learned my addr 172.21.15.97:0/1042095220 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d1bfff640 1 --1- 172.21.15.97:0/1042095220 >> v1:172.21.15.97:6789/0 conn(0x7f1d1c1322c0 0x7f1d1c1326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54148/0 (socket says 172.21.15.97:54148) 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d20a08640 1 -- 172.21.15.97:0/1042095220 >> v1:172.21.15.97:6789/0 conn(0x7f1d1c1322c0 legacy=0x7f1d1c1326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d20a08640 1 -- 172.21.15.97:0/1042095220 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c09c520 con 0x7f1d1c09c830 2024-09-11T14:29:20.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d1b7fe640 1 -- 172.21.15.97:0/1042095220 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424898767 0 0) 0x7f1d1c06ea50 con 0x7f1d1c1322c0 2024-09-11T14:29:20.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d20a08640 1 --2- 172.21.15.97:0/1042095220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c09cc40 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1c9df57b1dbab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:20.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d1b7fe640 1 -- 172.21.15.97:0/1042095220 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1d0c00e040 con 0x7f1d1c09c830 2024-09-11T14:29:20.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d1b7fe640 1 -- 172.21.15.97:0/1042095220 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1d0c0091e0 con 0x7f1d1c09c830 2024-09-11T14:29:20.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.387+0000 7f1d1b7fe640 1 -- 172.21.15.97:0/1042095220 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1d0c007730 con 0x7f1d1c09c830 2024-09-11T14:29:20.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 1 -- 172.21.15.97:0/1042095220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 msgr2=0x7f1d1c09cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:20.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 1 --2- 172.21.15.97:0/1042095220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c09cc40 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 1 -- 172.21.15.97:0/1042095220 shutdown_connections 2024-09-11T14:29:20.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 1 --2- 172.21.15.97:0/1042095220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c09cc40 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:20.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 1 -- 172.21.15.97:0/1042095220 >> 172.21.15.97:0/1042095220 conn(0x7f1d1c0a2000 msgr2=0x7f1d1c0a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:20.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 1 -- 172.21.15.97:0/1042095220 shutdown_connections 2024-09-11T14:29:20.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 1 -- 172.21.15.97:0/1042095220 wait complete. 2024-09-11T14:29:20.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.388+0000 7f1d22c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:20.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.390+0000 7f1d22c6c640 1 Processor -- start 2024-09-11T14:29:20.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.390+0000 7f1d22c6c640 1 -- start start 2024-09-11T14:29:20.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d22c6c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c1295d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:20.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d22c6c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c12c940 con 0x7f1d1c09c830 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d20a08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c1295d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d20a08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c1295d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46196/0 (socket says 172.21.15.97:46196) 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d20a08640 1 -- 172.21.15.97:0/4197886845 learned_addr learned my addr 172.21.15.97:0/4197886845 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d20a08640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c09a340 con 0x7f1d1c09c830 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d20a08640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c1295d0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.391+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1d0c007e80 con 0x7f1d1c09c830 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.392+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1d0c0094d0 con 0x7f1d1c09c830 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.392+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c12c5a0 con 0x7f1d1c09c830 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.392+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1d0c012a10 con 0x7f1d1c09c830 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.392+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c12cfd0 con 0x7f1d1c09c830 2024-09-11T14:29:20.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.392+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1d0c012c10 con 0x7f1d1c09c830 2024-09-11T14:29:20.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.393+0000 7f1d197fa640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1cfc03e8e0 0x7f1cfc040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:20.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.393+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(714..714 src has 397..714) ==== 4207+0+0 (crc 0 0 0) 0x7f1d0c0523f0 con 0x7f1d1c09c830 2024-09-11T14:29:20.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.393+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1c12c790 con 0x7f1d1c09c830 2024-09-11T14:29:20.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.393+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f1cfc045310 con 0x7f1d1c09c830 2024-09-11T14:29:20.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.393+0000 7f1d1bfff640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1cfc03e8e0 0x7f1cfc040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:20.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.393+0000 7f1d1bfff640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1cfc03e8e0 0x7f1cfc040df0 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:20.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.398+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1d0c014570 con 0x7f1d1c09c830 2024-09-11T14:29:20.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:20.584+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"} v 0) -- 0x7f1d1c09cc40 con 0x7f1d1c09c830 2024-09-11T14:29:21.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:21.458+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v715) ==== 217+0+0 (crc 0 0 0) 0x7f1d0c00faa0 con 0x7f1d1c09c830 2024-09-11T14:29:21.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:21.458+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(715..715 src has 397..715) ==== 628+0+0 (crc 0 0 0) 0x7f1d0c00e240 con 0x7f1d1c09c830 2024-09-11T14:29:21.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:21.458+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7f1cfc046090 con 0x7f1d1c09c830 2024-09-11T14:29:21.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:21.599+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"} v 0) -- 0x7f1d1c0008d0 con 0x7f1d1c09c830 2024-09-11T14:29:22.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.459+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v716) ==== 217+0+0 (crc 0 0 0) 0x7f1d0c00fc80 con 0x7f1d1c09c830 2024-09-11T14:29:22.461 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_bytes = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:29:22.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.459+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 <== mon.0 v2:172.21.15.97:3300/0 10 ==== osd_map(716..716 src has 397..716) ==== 628+0+0 (crc 0 0 0) 0x7f1d0c00ed00 con 0x7f1d1c09c830 2024-09-11T14:29:22.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.459+0000 7f1d197fa640 1 -- 172.21.15.97:0/4197886845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7f1cfc046300 con 0x7f1d1c09c830 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.463+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1cfc03e8e0 msgr2=0x7f1cfc040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.463+0000 7f1d22c6c640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1cfc03e8e0 0x7f1cfc040df0 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.463+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 msgr2=0x7f1d1c1295d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.463+0000 7f1d22c6c640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c1295d0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.464+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 shutdown_connections 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.464+0000 7f1d22c6c640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1cfc03e8e0 0x7f1cfc040df0 unknown :-1 s=CLOSED pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.464+0000 7f1d22c6c640 1 --2- 172.21.15.97:0/4197886845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d1c09c830 0x7f1d1c1295d0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.464+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 >> 172.21.15.97:0/4197886845 conn(0x7f1d1c0a2000 msgr2=0x7f1d1c1ba300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.464+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 shutdown_connections 2024-09-11T14:29:22.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.464+0000 7f1d22c6c640 1 -- 172.21.15.97:0/4197886845 wait complete. 2024-09-11T14:29:22.481 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool set-quota f2397458-472b-40b3-b6c8-73884edb56f3 max_objects 0 2024-09-11T14:29:22.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.582+0000 7f0845f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:22.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.592+0000 7f0845f11640 1 Processor -- start 2024-09-11T14:29:22.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.592+0000 7f0845f11640 1 -- start start 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f0845f11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f084009ed30 0x7f08401362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f0845f11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084009fd50 con 0x7f0840136800 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f0845f11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f084009fa40 con 0x7f084009ed30 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f083f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f084009ed30 0x7f08401362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f083f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f084009ed30 0x7f08401362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52408/0 (socket says 172.21.15.97:52408) 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f083f7fe640 1 -- 172.21.15.97:0/2925213114 learned_addr learned my addr 172.21.15.97:0/2925213114 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f083f7fe640 1 -- 172.21.15.97:0/2925213114 >> v1:172.21.15.97:6789/0 conn(0x7f0840136800 legacy=0x7f084006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:22.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.593+0000 7f083e7fc640 1 -- 172.21.15.97:0/2925213114 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047109351 0 0) 0x7f084009fd50 con 0x7f0840136800 2024-09-11T14:29:22.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.594+0000 7f083f7fe640 1 -- 172.21.15.97:0/2925213114 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084009ffe0 con 0x7f084009ed30 2024-09-11T14:29:22.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.594+0000 7f083f7fe640 1 --2- 172.21.15.97:0/2925213114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f08401362c0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb507ed25653e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:22.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.594+0000 7f083e7fc640 1 -- 172.21.15.97:0/2925213114 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0830009e50 con 0x7f084009ed30 2024-09-11T14:29:22.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.594+0000 7f083e7fc640 1 -- 172.21.15.97:0/2925213114 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f083000e230 con 0x7f084009ed30 2024-09-11T14:29:22.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.594+0000 7f083e7fc640 1 -- 172.21.15.97:0/2925213114 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f083000e4d0 con 0x7f084009ed30 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.595+0000 7f0845f11640 1 -- 172.21.15.97:0/2925213114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 msgr2=0x7f08401362c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.595+0000 7f0845f11640 1 --2- 172.21.15.97:0/2925213114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f08401362c0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.595+0000 7f0845f11640 1 -- 172.21.15.97:0/2925213114 shutdown_connections 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.595+0000 7f0845f11640 1 --2- 172.21.15.97:0/2925213114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f08401362c0 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.595+0000 7f0845f11640 1 -- 172.21.15.97:0/2925213114 >> 172.21.15.97:0/2925213114 conn(0x7f08400a5350 msgr2=0x7f08400a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.595+0000 7f0845f11640 1 -- 172.21.15.97:0/2925213114 shutdown_connections 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.595+0000 7f0845f11640 1 -- 172.21.15.97:0/2925213114 wait complete. 2024-09-11T14:29:22.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.596+0000 7f0845f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:22.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.597+0000 7f0845f11640 1 Processor -- start 2024-09-11T14:29:22.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.598+0000 7f0845f11640 1 -- start start 2024-09-11T14:29:22.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.599+0000 7f0845f11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f0840120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:22.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.599+0000 7f0845f11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0840122db0 con 0x7f084009ed30 2024-09-11T14:29:22.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.599+0000 7f083f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f0840120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:22.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.599+0000 7f083f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f0840120ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52420/0 (socket says 172.21.15.97:52420) 2024-09-11T14:29:22.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.599+0000 7f083f7fe640 1 -- 172.21.15.97:0/2488990734 learned_addr learned my addr 172.21.15.97:0/2488990734 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:22.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.599+0000 7f083f7fe640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0840124ad0 con 0x7f084009ed30 2024-09-11T14:29:22.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.600+0000 7f083f7fe640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f0840120ac0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:22.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.600+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f083000ee50 con 0x7f084009ed30 2024-09-11T14:29:22.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.600+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0840121e70 con 0x7f084009ed30 2024-09-11T14:29:22.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.600+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0830015420 con 0x7f084009ed30 2024-09-11T14:29:22.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.600+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f08300156c0 con 0x7f084009ed30 2024-09-11T14:29:22.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.600+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0840122500 con 0x7f084009ed30 2024-09-11T14:29:22.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.601+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f08300158c0 con 0x7f084009ed30 2024-09-11T14:29:22.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.601+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0840134da0 con 0x7f084009ed30 2024-09-11T14:29:22.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.601+0000 7f0827fff640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f082c03e8e0 0x7f082c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:22.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.601+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(716..716 src has 397..716) ==== 4207+0+0 (crc 0 0 0) 0x7f0830051340 con 0x7f084009ed30 2024-09-11T14:29:22.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.601+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7f082c045310 con 0x7f084009ed30 2024-09-11T14:29:22.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.602+0000 7f083effd640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f082c03e8e0 0x7f082c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:22.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.602+0000 7f083effd640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f082c03e8e0 0x7f082c040df0 crc :-1 s=READY pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:22.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.606+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0830014c60 con 0x7f084009ed30 2024-09-11T14:29:22.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:22.782+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"} v 0) -- 0x7f08401362c0 con 0x7f084009ed30 2024-09-11T14:29:23.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:23.468+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v717) ==== 221+0+0 (crc 0 0 0) 0x7f08300129e0 con 0x7f084009ed30 2024-09-11T14:29:23.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:23.469+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(717..717 src has 397..717) ==== 628+0+0 (crc 0 0 0) 0x7f0830012d80 con 0x7f084009ed30 2024-09-11T14:29:23.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:23.469+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7f082c046090 con 0x7f084009ed30 2024-09-11T14:29:23.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:23.591+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"} v 0) -- 0x7f0840076080 con 0x7f084009ed30 2024-09-11T14:29:24.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.470+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 v718) ==== 221+0+0 (crc 0 0 0) 0x7f0830012bc0 con 0x7f084009ed30 2024-09-11T14:29:24.471 INFO:tasks.workunit.client.0.smithi097.stderr:set-quota max_objects = 0 for pool f2397458-472b-40b3-b6c8-73884edb56f3 2024-09-11T14:29:24.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.470+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 <== mon.0 v2:172.21.15.97:3300/0 10 ==== osd_map(718..718 src has 397..718) ==== 628+0+0 (crc 0 0 0) 0x7f0830011e00 con 0x7f084009ed30 2024-09-11T14:29:24.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.470+0000 7f0827fff640 1 -- 172.21.15.97:0/2488990734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7f082c046300 con 0x7f084009ed30 2024-09-11T14:29:24.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f082c03e8e0 msgr2=0x7f082c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:24.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f082c03e8e0 0x7f082c040df0 crc :-1 s=READY pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:24.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 msgr2=0x7f0840120ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:24.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f0840120ac0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:24.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 shutdown_connections 2024-09-11T14:29:24.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f082c03e8e0 0x7f082c040df0 unknown :-1 s=CLOSED pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:24.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 --2- 172.21.15.97:0/2488990734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f084009ed30 0x7f0840120ac0 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:24.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 >> 172.21.15.97:0/2488990734 conn(0x7f08400a5350 msgr2=0x7f08401bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:24.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 shutdown_connections 2024-09-11T14:29:24.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:24.473+0000 7f0845f11640 1 -- 172.21.15.97:0/2488990734 wait complete. 2024-09-11T14:29:24.489 INFO:tasks.workunit.client.0.smithi097.stderr:+ sleep 30 2024-09-11T14:29:54.491 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool delete f2397458-472b-40b3-b6c8-73884edb56f3 f2397458-472b-40b3-b6c8-73884edb56f3 --yes-i-really-really-mean-it 2024-09-11T14:29:54.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.593+0000 7fc9c9b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:54.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.604+0000 7fc9c9b11640 1 Processor -- start 2024-09-11T14:29:54.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.604+0000 7fc9c9b11640 1 -- start start 2024-09-11T14:29:54.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c9b11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc9c4134150 0x7fc9c4134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:54.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c9b11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c409dda0 con 0x7fc9c4072cd0 2024-09-11T14:29:54.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c9b11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c40a6280 con 0x7fc9c4134150 2024-09-11T14:29:54.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc9c4134150 0x7fc9c4134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:54.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc9c4072cd0 0x7fc9c40730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52390/0 (socket says 172.21.15.97:52390) 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc9c4134150 0x7fc9c4134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56362/0 (socket says 172.21.15.97:56362) 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c2ffd640 1 -- 172.21.15.97:0/4271631443 learned_addr learned my addr 172.21.15.97:0/4271631443 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c37fe640 1 -- 172.21.15.97:0/4271631443 >> v1:172.21.15.97:6789/0 conn(0x7fc9c4072cd0 legacy=0x7fc9c40730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.605+0000 7fc9c37fe640 1 -- 172.21.15.97:0/4271631443 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c409ef80 con 0x7fc9c4134150 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.606+0000 7fc9c37fe640 1 --2- 172.21.15.97:0/4271631443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4134150 0x7fc9c4134560 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249e5c859f1fb7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.606+0000 7fc9c27fc640 1 -- 172.21.15.97:0/4271631443 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b4009d90 con 0x7fc9c4134150 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.606+0000 7fc9c27fc640 1 -- 172.21.15.97:0/4271631443 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc9b400e230 con 0x7fc9c4134150 2024-09-11T14:29:54.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.606+0000 7fc9c27fc640 1 -- 172.21.15.97:0/4271631443 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b400e4d0 con 0x7fc9c4134150 2024-09-11T14:29:54.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 1 -- 172.21.15.97:0/4271631443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4134150 msgr2=0x7fc9c4134560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:54.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 1 --2- 172.21.15.97:0/4271631443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4134150 0x7fc9c4134560 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 1 -- 172.21.15.97:0/4271631443 shutdown_connections 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 1 --2- 172.21.15.97:0/4271631443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4134150 0x7fc9c4134560 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 1 -- 172.21.15.97:0/4271631443 >> 172.21.15.97:0/4271631443 conn(0x7fc9c40a43d0 msgr2=0x7fc9c40a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 1 -- 172.21.15.97:0/4271631443 shutdown_connections 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 1 -- 172.21.15.97:0/4271631443 wait complete. 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.607+0000 7fc9c9b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.608+0000 7fc9c9b11640 1 Processor -- start 2024-09-11T14:29:54.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.608+0000 7fc9c9b11640 1 -- start start 2024-09-11T14:29:54.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.609+0000 7fc9c9b11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4072cd0 0x7fc9c4121150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.609+0000 7fc9c9b11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4124550 con 0x7fc9c4072cd0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9c37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4072cd0 0x7fc9c4121150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9c37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4072cd0 0x7fc9c4121150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56368/0 (socket says 172.21.15.97:56368) 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9c37fe640 1 -- 172.21.15.97:0/3118940576 learned_addr learned my addr 172.21.15.97:0/3118940576 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9c37fe640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c4122bd0 con 0x7fc9c4072cd0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9c37fe640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4072cd0 0x7fc9c4121150 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b4014620 con 0x7fc9c4072cd0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc9b4014780 con 0x7fc9c4072cd0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b4014a20 con 0x7fc9c4072cd0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c41241b0 con 0x7fc9c4072cd0 2024-09-11T14:29:54.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.610+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c4123420 con 0x7fc9c4072cd0 2024-09-11T14:29:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.611+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c409e4c0 con 0x7fc9c4072cd0 2024-09-11T14:29:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.611+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc9b4014bd0 con 0x7fc9c4072cd0 2024-09-11T14:29:54.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.611+0000 7fc9abfff640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc9b003e930 0x7fc9b0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:54.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.612+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(718..718 src has 397..718) ==== 4207+0+0 (crc 0 0 0) 0x7fc9b4019040 con 0x7fc9c4072cd0 2024-09-11T14:29:54.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.612+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7fc9b0045360 con 0x7fc9c4072cd0 2024-09-11T14:29:54.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.612+0000 7fc9c2ffd640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc9b003e930 0x7fc9b0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:54.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.612+0000 7fc9c2ffd640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc9b003e930 0x7fc9b0040e40 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:54.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.617+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc9b4012580 con 0x7fc9c4072cd0 2024-09-11T14:29:54.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:54.793+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pool2": "f2397458-472b-40b3-b6c8-73884edb56f3", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9c409f3a0 con 0x7fc9c4072cd0 2024-09-11T14:29:55.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.467+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pool2": "f2397458-472b-40b3-b6c8-73884edb56f3", "yes_i_really_really_mean_it": true}]=0 pool 'f2397458-472b-40b3-b6c8-73884edb56f3' removed v719) ==== 248+0+0 (crc 0 0 0) 0x7fc9b4008f20 con 0x7fc9c4072cd0 2024-09-11T14:29:55.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.468+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(719..719 src has 397..719) ==== 296+0+0 (crc 0 0 0) 0x7fc9b4018710 con 0x7fc9c4072cd0 2024-09-11T14:29:55.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.468+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7fc9b0046010 con 0x7fc9c4072cd0 2024-09-11T14:29:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.635+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pool2": "f2397458-472b-40b3-b6c8-73884edb56f3", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9c409dfb0 con 0x7fc9c4072cd0 2024-09-11T14:29:55.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.636+0000 7fc9abfff640 1 -- 172.21.15.97:0/3118940576 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "f2397458-472b-40b3-b6c8-73884edb56f3", "pool2": "f2397458-472b-40b3-b6c8-73884edb56f3", "yes_i_really_really_mean_it": true}]=0 pool 'f2397458-472b-40b3-b6c8-73884edb56f3' does not exist v719) ==== 255+0+0 (crc 0 0 0) 0x7fc9b4018190 con 0x7fc9c4072cd0 2024-09-11T14:29:55.637 INFO:tasks.workunit.client.0.smithi097.stderr:pool 'f2397458-472b-40b3-b6c8-73884edb56f3' does not exist 2024-09-11T14:29:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc9b003e930 msgr2=0x7fc9b0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc9b003e930 0x7fc9b0040e40 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4072cd0 msgr2=0x7fc9c4121150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4072cd0 0x7fc9c4121150 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 shutdown_connections 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fc9b003e930 0x7fc9b0040e40 unknown :-1 s=CLOSED pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 --2- 172.21.15.97:0/3118940576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc9c4072cd0 0x7fc9c4121150 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 >> 172.21.15.97:0/3118940576 conn(0x7fc9c40a43d0 msgr2=0x7fc9c4133630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 shutdown_connections 2024-09-11T14:29:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.638+0000 7fc9c9b11640 1 -- 172.21.15.97:0/3118940576 wait complete. 2024-09-11T14:29:55.650 INFO:tasks.workunit.client.0.smithi097.stderr:+ ceph osd pool delete 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 30a1627b-5bb9-4a6c-ba13-11612e8d66f2 --yes-i-really-really-mean-it 2024-09-11T14:29:55.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.738+0000 7fa4feb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:55.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.749+0000 7fa4feb91640 1 Processor -- start 2024-09-11T14:29:55.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.749+0000 7fa4feb91640 1 -- start start 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4feb91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa4f809ed30 0x7fa4f81362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4feb91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f809fd50 con 0x7fa4f8136800 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4feb91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f809fa40 con 0x7fa4f809ed30 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4fc92d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa4f809ed30 0x7fa4f81362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4fc92d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa4f809ed30 0x7fa4f81362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56380/0 (socket says 172.21.15.97:56380) 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4f7fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa4f8136800 0x7fa4f806ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52400/0 (socket says 172.21.15.97:52400) 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4fc92d640 1 -- 172.21.15.97:0/4135368173 learned_addr learned my addr 172.21.15.97:0/4135368173 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4fc92d640 1 -- 172.21.15.97:0/4135368173 >> v1:172.21.15.97:6789/0 conn(0x7fa4f8136800 legacy=0x7fa4f806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4fc92d640 1 -- 172.21.15.97:0/4135368173 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f809ffe0 con 0x7fa4f809ed30 2024-09-11T14:29:55.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4fc92d640 1 --2- 172.21.15.97:0/4135368173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f81362c0 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e400b7f7465c4e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:55.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.750+0000 7fa4f77fe640 1 -- 172.21.15.97:0/4135368173 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4e8009e50 con 0x7fa4f809ed30 2024-09-11T14:29:55.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4f77fe640 1 -- 172.21.15.97:0/4135368173 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa4e800e230 con 0x7fa4f809ed30 2024-09-11T14:29:55.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4f77fe640 1 -- 172.21.15.97:0/4135368173 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4e800e4d0 con 0x7fa4f809ed30 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4feb91640 1 -- 172.21.15.97:0/4135368173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 msgr2=0x7fa4f81362c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4feb91640 1 --2- 172.21.15.97:0/4135368173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f81362c0 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4feb91640 1 -- 172.21.15.97:0/4135368173 shutdown_connections 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4feb91640 1 --2- 172.21.15.97:0/4135368173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f81362c0 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4feb91640 1 -- 172.21.15.97:0/4135368173 >> 172.21.15.97:0/4135368173 conn(0x7fa4f80a5350 msgr2=0x7fa4f80a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4feb91640 1 -- 172.21.15.97:0/4135368173 shutdown_connections 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.751+0000 7fa4feb91640 1 -- 172.21.15.97:0/4135368173 wait complete. 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.752+0000 7fa4feb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:55.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.753+0000 7fa4feb91640 1 Processor -- start 2024-09-11T14:29:55.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.753+0000 7fa4feb91640 1 -- start start 2024-09-11T14:29:55.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.754+0000 7fa4feb91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f8121a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:55.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.754+0000 7fa4feb91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8122d80 con 0x7fa4f809ed30 2024-09-11T14:29:55.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.754+0000 7fa4fc92d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f8121a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:55.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.754+0000 7fa4fc92d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f8121a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56388/0 (socket says 172.21.15.97:56388) 2024-09-11T14:29:55.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.754+0000 7fa4fc92d640 1 -- 172.21.15.97:0/3195315962 learned_addr learned my addr 172.21.15.97:0/3195315962 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:55.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.754+0000 7fa4fc92d640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f8135cc0 con 0x7fa4f809ed30 2024-09-11T14:29:55.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.755+0000 7fa4fc92d640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f8121a40 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:55.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.755+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4e800eda0 con 0x7fa4f809ed30 2024-09-11T14:29:55.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.755+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa4e8015420 con 0x7fa4f809ed30 2024-09-11T14:29:55.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.755+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f8125a20 con 0x7fa4f809ed30 2024-09-11T14:29:55.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.755+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4e80156c0 con 0x7fa4f809ed30 2024-09-11T14:29:55.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.755+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f80a3870 con 0x7fa4f809ed30 2024-09-11T14:29:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.756+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f8123cf0 con 0x7fa4f809ed30 2024-09-11T14:29:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.756+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa4e8015870 con 0x7fa4f809ed30 2024-09-11T14:29:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.756+0000 7fa4f57fa640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa4e403e930 0x7fa4e4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.756+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(719..719 src has 397..719) ==== 3819+0+0 (crc 0 0 0) 0x7fa4e80510f0 con 0x7fa4f809ed30 2024-09-11T14:29:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.756+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7fa4e4044bc0 con 0x7fa4f809ed30 2024-09-11T14:29:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.756+0000 7fa4f7fff640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa4e403e930 0x7fa4e4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:55.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.757+0000 7fa4f7fff640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa4e403e930 0x7fa4e4040e40 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:55.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.761+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa4e8014c60 con 0x7fa4f809ed30 2024-09-11T14:29:55.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:55.940+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pool2": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa4f81362c0 con 0x7fa4f809ed30 2024-09-11T14:29:56.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.468+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pool2": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "yes_i_really_really_mean_it": true}]=0 pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' removed v720) ==== 248+0+0 (crc 0 0 0) 0x7fa4e8012b80 con 0x7fa4f809ed30 2024-09-11T14:29:56.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.468+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(720..720 src has 397..720) ==== 296+0+0 (crc 0 0 0) 0x7fa4e8012d40 con 0x7fa4f809ed30 2024-09-11T14:29:56.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.468+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7fa4e4045780 con 0x7fa4f809ed30 2024-09-11T14:29:56.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.647+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pool2": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa4f8076080 con 0x7fa4f809ed30 2024-09-11T14:29:56.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.648+0000 7fa4f57fa640 1 -- 172.21.15.97:0/3195315962 <== mon.0 v2:172.21.15.97:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "pool2": "30a1627b-5bb9-4a6c-ba13-11612e8d66f2", "yes_i_really_really_mean_it": true}]=0 pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' does not exist v720) ==== 255+0+0 (crc 0 0 0) 0x7fa4e800f2a0 con 0x7fa4f809ed30 2024-09-11T14:29:56.649 INFO:tasks.workunit.client.0.smithi097.stderr:pool '30a1627b-5bb9-4a6c-ba13-11612e8d66f2' does not exist 2024-09-11T14:29:56.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa4e403e930 msgr2=0x7fa4e4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa4e403e930 0x7fa4e4040e40 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 msgr2=0x7fa4f8121a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f8121a40 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 shutdown_connections 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa4e403e930 0x7fa4e4040e40 unknown :-1 s=CLOSED pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 --2- 172.21.15.97:0/3195315962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4f809ed30 0x7fa4f8121a40 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 >> 172.21.15.97:0/3195315962 conn(0x7fa4f80a5350 msgr2=0x7fa4f80a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 shutdown_connections 2024-09-11T14:29:56.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-11T14:29:56.651+0000 7fa4feb91640 1 -- 172.21.15.97:0/3195315962 wait complete. 2024-09-11T14:29:56.663 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo OK 2024-09-11T14:29:56.664 INFO:tasks.workunit.client.0.smithi097.stdout:OK 2024-09-11T14:29:56.664 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T14:29:56.665 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T14:29:56.729 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-11T14:29:56.729 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T14:29:57.051 DEBUG:teuthology.parallel:result is None 2024-09-11T14:29:57.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:29:57.076 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:29:57.077 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:29:57.143 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:29:57.143 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T14:29:57.152 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:29:57.153 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:29:57.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.287+0000 7f813fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:57.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.292+0000 7f813fd91640 1 Processor -- start 2024-09-11T14:29:57.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.292+0000 7f813fd91640 1 -- start start 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813fd91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81381360f0 0x7f8138136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813fd91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81380a5c40 con 0x7f813809e170 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813fd91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f81380a6010 con 0x7f81381360f0 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813db2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81381360f0 0x7f8138136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813db2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81381360f0 0x7f8138136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56396/0 (socket says 172.21.15.97:56396) 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813d32c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f813809e170 0x7f813809e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52404/0 (socket says 172.21.15.97:52404) 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813db2d640 1 -- 172.21.15.97:0/2824347697 learned_addr learned my addr 172.21.15.97:0/2824347697 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813db2d640 1 -- 172.21.15.97:0/2824347697 >> v1:172.21.15.97:6789/0 conn(0x7f813809e170 legacy=0x7f813809e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813cb2b640 1 -- 172.21.15.97:0/2824347697 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089741758 0 0) 0x7f81380a5c40 con 0x7f813809e170 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813db2d640 1 -- 172.21.15.97:0/2824347697 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813809f510 con 0x7f81381360f0 2024-09-11T14:29:57.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.293+0000 7f813db2d640 1 --2- 172.21.15.97:0/2824347697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81381360f0 0x7f8138136500 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f84d2c4b45d28a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813cb2b640 1 -- 172.21.15.97:0/2824347697 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8128009e50 con 0x7f81381360f0 2024-09-11T14:29:57.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813cb2b640 1 -- 172.21.15.97:0/2824347697 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f812800e230 con 0x7f81381360f0 2024-09-11T14:29:57.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813cb2b640 1 -- 172.21.15.97:0/2824347697 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f812800e4d0 con 0x7f81381360f0 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813fd91640 1 -- 172.21.15.97:0/2824347697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81381360f0 msgr2=0x7f8138136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813fd91640 1 --2- 172.21.15.97:0/2824347697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81381360f0 0x7f8138136500 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813fd91640 1 -- 172.21.15.97:0/2824347697 shutdown_connections 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813fd91640 1 --2- 172.21.15.97:0/2824347697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81381360f0 0x7f8138136500 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813fd91640 1 -- 172.21.15.97:0/2824347697 >> 172.21.15.97:0/2824347697 conn(0x7f813806f850 msgr2=0x7f813809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813fd91640 1 -- 172.21.15.97:0/2824347697 shutdown_connections 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.294+0000 7f813fd91640 1 -- 172.21.15.97:0/2824347697 wait complete. 2024-09-11T14:29:57.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.295+0000 7f813fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:57.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.296+0000 7f813fd91640 1 Processor -- start 2024-09-11T14:29:57.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.296+0000 7f813fd91640 1 -- start start 2024-09-11T14:29:57.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.297+0000 7f813fd91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f813809e170 0x7f8138120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.297+0000 7f813fd91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8138124ba0 con 0x7f813809e170 2024-09-11T14:29:57.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.297+0000 7f813db2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f813809e170 0x7f8138120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.297+0000 7f813db2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f813809e170 0x7f8138120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56406/0 (socket says 172.21.15.97:56406) 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.297+0000 7f813db2d640 1 -- 172.21.15.97:0/2156096281 learned_addr learned my addr 172.21.15.97:0/2156096281 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.297+0000 7f813db2d640 1 -- 172.21.15.97:0/2156096281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8138124810 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.298+0000 7f813db2d640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f813809e170 0x7f8138120b70 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.298+0000 7f81367fc640 1 -- 172.21.15.97:0/2156096281 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f812800ede0 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.298+0000 7f81367fc640 1 -- 172.21.15.97:0/2156096281 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8128015420 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.298+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8138121ff0 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.298+0000 7f81367fc640 1 -- 172.21.15.97:0/2156096281 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f81280156c0 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.298+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8138124500 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.299+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81380008d0 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.299+0000 7f81367fc640 1 -- 172.21.15.97:0/2156096281 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8128015870 con 0x7f813809e170 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.299+0000 7f81367fc640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f812403e930 0x7f8124040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.299+0000 7f81367fc640 1 -- 172.21.15.97:0/2156096281 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f8128050ed0 con 0x7f813809e170 2024-09-11T14:29:57.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.299+0000 7f813d32c640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f812403e930 0x7f8124040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.300+0000 7f813d32c640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f812403e930 0x7f8124040e40 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.304+0000 7f81367fc640 1 -- 172.21.15.97:0/2156096281 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f8128010a00 con 0x7f813809e170 2024-09-11T14:29:57.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.477+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f813806fec0 con 0x7f812403e930 2024-09-11T14:29:57.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.480+0000 7f81367fc640 1 -- 172.21.15.97:0/2156096281 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109237 (crc 0 0 0) 0x7f812c0070b0 con 0x7f812403e930 2024-09-11T14:29:57.482 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:29:57.483 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:29:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f812403e930 msgr2=0x7f8124040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f812403e930 0x7f8124040e40 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f813809e170 msgr2=0x7f8138120b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f813809e170 0x7f8138120b70 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 shutdown_connections 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f812403e930 0x7f8124040e40 unknown :-1 s=CLOSED pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 --2- 172.21.15.97:0/2156096281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f813809e170 0x7f8138120b70 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 >> 172.21.15.97:0/2156096281 conn(0x7f813806f850 msgr2=0x7f81381bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 shutdown_connections 2024-09-11T14:29:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.482+0000 7f813fd91640 1 -- 172.21.15.97:0/2156096281 wait complete. 2024-09-11T14:29:57.495 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1283,"stamp":"2024-09-11T14:29:56.798172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259128,"kb_used_data":14380,"kb_used_omap":0,"kb_used_meta":244672,"kb_avail":377228232,"statfs":{"total":386547056640,"available":386281709568,"internally_reserved":0,"allocated":14725120,"data_stored":7210725,"data_compressed":354490,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":250544128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001990"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504619+0000","last_change":"2024-09-11T14:16:01.478105+0000","last_active":"2024-09-11T14:29:55.504619+0000","last_peered":"2024-09-11T14:29:55.504619+0000","last_clean":"2024-09-11T14:29:55.504619+0000","last_became_active":"2024-09-11T14:16:01.469796+0000","last_became_peered":"2024-09-11T14:16:01.469796+0000","last_unstale":"2024-09-11T14:29:55.504619+0000","last_undegraded":"2024-09-11T14:29:55.504619+0000","last_fullsized":"2024-09-11T14:29:55.504619+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.505673+0000","last_change":"2024-09-11T14:16:01.566671+0000","last_active":"2024-09-11T14:29:55.505673+0000","last_peered":"2024-09-11T14:29:55.505673+0000","last_clean":"2024-09-11T14:29:55.505673+0000","last_became_active":"2024-09-11T14:16:01.553483+0000","last_became_peered":"2024-09-11T14:16:01.553483+0000","last_unstale":"2024-09-11T14:29:55.505673+0000","last_undegraded":"2024-09-11T14:29:55.505673+0000","last_fullsized":"2024-09-11T14:29:55.505673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.500570+0000","last_change":"2024-09-11T14:16:01.491814+0000","last_active":"2024-09-11T14:29:55.500570+0000","last_peered":"2024-09-11T14:29:55.500570+0000","last_clean":"2024-09-11T14:29:55.500570+0000","last_became_active":"2024-09-11T14:16:01.485851+0000","last_became_peered":"2024-09-11T14:16:01.485851+0000","last_unstale":"2024-09-11T14:29:55.500570+0000","last_undegraded":"2024-09-11T14:29:55.500570+0000","last_fullsized":"2024-09-11T14:29:55.500570+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.488003+0000","last_change":"2024-09-11T14:16:01.497743+0000","last_active":"2024-09-11T14:29:55.488003+0000","last_peered":"2024-09-11T14:29:55.488003+0000","last_clean":"2024-09-11T14:29:55.488003+0000","last_became_active":"2024-09-11T14:16:01.469079+0000","last_became_peered":"2024-09-11T14:16:01.469079+0000","last_unstale":"2024-09-11T14:29:55.488003+0000","last_undegraded":"2024-09-11T14:29:55.488003+0000","last_fullsized":"2024-09-11T14:29:55.488003+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489764+0000","last_change":"2024-09-11T14:16:01.492881+0000","last_active":"2024-09-11T14:29:55.489764+0000","last_peered":"2024-09-11T14:29:55.489764+0000","last_clean":"2024-09-11T14:29:55.489764+0000","last_became_active":"2024-09-11T14:16:01.480473+0000","last_became_peered":"2024-09-11T14:16:01.480473+0000","last_unstale":"2024-09-11T14:29:55.489764+0000","last_undegraded":"2024-09-11T14:29:55.489764+0000","last_fullsized":"2024-09-11T14:29:55.489764+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.490446+0000","last_change":"2024-09-11T14:16:01.541899+0000","last_active":"2024-09-11T14:29:55.490446+0000","last_peered":"2024-09-11T14:29:55.490446+0000","last_clean":"2024-09-11T14:29:55.490446+0000","last_became_active":"2024-09-11T14:16:01.515259+0000","last_became_peered":"2024-09-11T14:16:01.515259+0000","last_unstale":"2024-09-11T14:29:55.490446+0000","last_undegraded":"2024-09-11T14:29:55.490446+0000","last_fullsized":"2024-09-11T14:29:55.490446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515043+0000","last_change":"2024-09-11T14:16:01.523684+0000","last_active":"2024-09-11T14:29:55.515043+0000","last_peered":"2024-09-11T14:29:55.515043+0000","last_clean":"2024-09-11T14:29:55.515043+0000","last_became_active":"2024-09-11T14:16:01.510524+0000","last_became_peered":"2024-09-11T14:16:01.510524+0000","last_unstale":"2024-09-11T14:29:55.515043+0000","last_undegraded":"2024-09-11T14:29:55.515043+0000","last_fullsized":"2024-09-11T14:29:55.515043+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523629+0000","last_change":"2024-09-11T14:16:01.525329+0000","last_active":"2024-09-11T14:29:55.523629+0000","last_peered":"2024-09-11T14:29:55.523629+0000","last_clean":"2024-09-11T14:29:55.523629+0000","last_became_active":"2024-09-11T14:16:01.514773+0000","last_became_peered":"2024-09-11T14:16:01.514773+0000","last_unstale":"2024-09-11T14:29:55.523629+0000","last_undegraded":"2024-09-11T14:29:55.523629+0000","last_fullsized":"2024-09-11T14:29:55.523629+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.498084+0000","last_change":"2024-09-11T14:16:01.533436+0000","last_active":"2024-09-11T14:29:55.498084+0000","last_peered":"2024-09-11T14:29:55.498084+0000","last_clean":"2024-09-11T14:29:55.498084+0000","last_became_active":"2024-09-11T14:16:01.525822+0000","last_became_peered":"2024-09-11T14:16:01.525822+0000","last_unstale":"2024-09-11T14:29:55.498084+0000","last_undegraded":"2024-09-11T14:29:55.498084+0000","last_fullsized":"2024-09-11T14:29:55.498084+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.487709+0000","last_change":"2024-09-11T14:16:01.514314+0000","last_active":"2024-09-11T14:29:55.487709+0000","last_peered":"2024-09-11T14:29:55.487709+0000","last_clean":"2024-09-11T14:29:55.487709+0000","last_became_active":"2024-09-11T14:16:01.499412+0000","last_became_peered":"2024-09-11T14:16:01.499412+0000","last_unstale":"2024-09-11T14:29:55.487709+0000","last_undegraded":"2024-09-11T14:29:55.487709+0000","last_fullsized":"2024-09-11T14:29:55.487709+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.507704+0000","last_change":"2024-09-11T14:16:01.517824+0000","last_active":"2024-09-11T14:29:55.507704+0000","last_peered":"2024-09-11T14:29:55.507704+0000","last_clean":"2024-09-11T14:29:55.507704+0000","last_became_active":"2024-09-11T14:16:01.507489+0000","last_became_peered":"2024-09-11T14:16:01.507489+0000","last_unstale":"2024-09-11T14:29:55.507704+0000","last_undegraded":"2024-09-11T14:29:55.507704+0000","last_fullsized":"2024-09-11T14:29:55.507704+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523786+0000","last_change":"2024-09-11T14:16:01.572297+0000","last_active":"2024-09-11T14:29:55.523786+0000","last_peered":"2024-09-11T14:29:55.523786+0000","last_clean":"2024-09-11T14:29:55.523786+0000","last_became_active":"2024-09-11T14:16:01.564983+0000","last_became_peered":"2024-09-11T14:16:01.564983+0000","last_unstale":"2024-09-11T14:29:55.523786+0000","last_undegraded":"2024-09-11T14:29:55.523786+0000","last_fullsized":"2024-09-11T14:29:55.523786+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.492434+0000","last_change":"2024-09-11T14:16:01.553374+0000","last_active":"2024-09-11T14:29:55.492434+0000","last_peered":"2024-09-11T14:29:55.492434+0000","last_clean":"2024-09-11T14:29:55.492434+0000","last_became_active":"2024-09-11T14:16:01.546695+0000","last_became_peered":"2024-09-11T14:16:01.546695+0000","last_unstale":"2024-09-11T14:29:55.492434+0000","last_undegraded":"2024-09-11T14:29:55.492434+0000","last_fullsized":"2024-09-11T14:29:55.492434+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.494645+0000","last_change":"2024-09-11T14:16:01.549306+0000","last_active":"2024-09-11T14:29:55.494645+0000","last_peered":"2024-09-11T14:29:55.494645+0000","last_clean":"2024-09-11T14:29:55.494645+0000","last_became_active":"2024-09-11T14:16:01.541719+0000","last_became_peered":"2024-09-11T14:16:01.541719+0000","last_unstale":"2024-09-11T14:29:55.494645+0000","last_undegraded":"2024-09-11T14:29:55.494645+0000","last_fullsized":"2024-09-11T14:29:55.494645+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511367+0000","last_change":"2024-09-11T14:16:01.609878+0000","last_active":"2024-09-11T14:29:55.511367+0000","last_peered":"2024-09-11T14:29:55.511367+0000","last_clean":"2024-09-11T14:29:55.511367+0000","last_became_active":"2024-09-11T14:16:01.598547+0000","last_became_peered":"2024-09-11T14:16:01.598547+0000","last_unstale":"2024-09-11T14:29:55.511367+0000","last_undegraded":"2024-09-11T14:29:55.511367+0000","last_fullsized":"2024-09-11T14:29:55.511367+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.493382+0000","last_change":"2024-09-11T14:16:01.555603+0000","last_active":"2024-09-11T14:29:55.493382+0000","last_peered":"2024-09-11T14:29:55.493382+0000","last_clean":"2024-09-11T14:29:55.493382+0000","last_became_active":"2024-09-11T14:16:01.528427+0000","last_became_peered":"2024-09-11T14:16:01.528427+0000","last_unstale":"2024-09-11T14:29:55.493382+0000","last_undegraded":"2024-09-11T14:29:55.493382+0000","last_fullsized":"2024-09-11T14:29:55.493382+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.532842+0000","last_change":"2024-09-11T14:16:01.556304+0000","last_active":"2024-09-11T14:29:55.532842+0000","last_peered":"2024-09-11T14:29:55.532842+0000","last_clean":"2024-09-11T14:29:55.532842+0000","last_became_active":"2024-09-11T14:16:01.540687+0000","last_became_peered":"2024-09-11T14:16:01.540687+0000","last_unstale":"2024-09-11T14:29:55.532842+0000","last_undegraded":"2024-09-11T14:29:55.532842+0000","last_fullsized":"2024-09-11T14:29:55.532842+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497272+0000","last_change":"2024-09-11T14:16:01.494968+0000","last_active":"2024-09-11T14:29:55.497272+0000","last_peered":"2024-09-11T14:29:55.497272+0000","last_clean":"2024-09-11T14:29:55.497272+0000","last_became_active":"2024-09-11T14:16:01.475901+0000","last_became_peered":"2024-09-11T14:16:01.475901+0000","last_unstale":"2024-09-11T14:29:55.497272+0000","last_undegraded":"2024-09-11T14:29:55.497272+0000","last_fullsized":"2024-09-11T14:29:55.497272+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504034+0000","last_change":"2024-09-11T14:16:01.496009+0000","last_active":"2024-09-11T14:29:55.504034+0000","last_peered":"2024-09-11T14:29:55.504034+0000","last_clean":"2024-09-11T14:29:55.504034+0000","last_became_active":"2024-09-11T14:16:01.485861+0000","last_became_peered":"2024-09-11T14:16:01.485861+0000","last_unstale":"2024-09-11T14:29:55.504034+0000","last_undegraded":"2024-09-11T14:29:55.504034+0000","last_fullsized":"2024-09-11T14:29:55.504034+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503865+0000","last_change":"2024-09-11T14:16:01.511330+0000","last_active":"2024-09-11T14:29:55.503865+0000","last_peered":"2024-09-11T14:29:55.503865+0000","last_clean":"2024-09-11T14:29:55.503865+0000","last_became_active":"2024-09-11T14:16:01.497752+0000","last_became_peered":"2024-09-11T14:16:01.497752+0000","last_unstale":"2024-09-11T14:29:55.503865+0000","last_undegraded":"2024-09-11T14:29:55.503865+0000","last_fullsized":"2024-09-11T14:29:55.503865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503010+0000","last_change":"2024-09-11T14:16:01.548238+0000","last_active":"2024-09-11T14:29:55.503010+0000","last_peered":"2024-09-11T14:29:55.503010+0000","last_clean":"2024-09-11T14:29:55.503010+0000","last_became_active":"2024-09-11T14:16:01.540272+0000","last_became_peered":"2024-09-11T14:16:01.540272+0000","last_unstale":"2024-09-11T14:29:55.503010+0000","last_undegraded":"2024-09-11T14:29:55.503010+0000","last_fullsized":"2024-09-11T14:29:55.503010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491594+0000","last_change":"2024-09-11T14:16:01.530012+0000","last_active":"2024-09-11T14:29:55.491594+0000","last_peered":"2024-09-11T14:29:55.491594+0000","last_clean":"2024-09-11T14:29:55.491594+0000","last_became_active":"2024-09-11T14:16:01.516906+0000","last_became_peered":"2024-09-11T14:16:01.516906+0000","last_unstale":"2024-09-11T14:29:55.491594+0000","last_undegraded":"2024-09-11T14:29:55.491594+0000","last_fullsized":"2024-09-11T14:29:55.491594+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.501848+0000","last_change":"2024-09-11T14:16:01.535163+0000","last_active":"2024-09-11T14:29:55.501848+0000","last_peered":"2024-09-11T14:29:55.501848+0000","last_clean":"2024-09-11T14:29:55.501848+0000","last_became_active":"2024-09-11T14:16:01.524168+0000","last_became_peered":"2024-09-11T14:16:01.524168+0000","last_unstale":"2024-09-11T14:29:55.501848+0000","last_undegraded":"2024-09-11T14:29:55.501848+0000","last_fullsized":"2024-09-11T14:29:55.501848+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.520363+0000","last_change":"2024-09-11T14:16:01.525020+0000","last_active":"2024-09-11T14:29:55.520363+0000","last_peered":"2024-09-11T14:29:55.520363+0000","last_clean":"2024-09-11T14:29:55.520363+0000","last_became_active":"2024-09-11T14:16:01.519043+0000","last_became_peered":"2024-09-11T14:16:01.519043+0000","last_unstale":"2024-09-11T14:29:55.520363+0000","last_undegraded":"2024-09-11T14:29:55.520363+0000","last_fullsized":"2024-09-11T14:29:55.520363+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511420+0000","last_change":"2024-09-11T14:16:01.514997+0000","last_active":"2024-09-11T14:29:55.511420+0000","last_peered":"2024-09-11T14:29:55.511420+0000","last_clean":"2024-09-11T14:29:55.511420+0000","last_became_active":"2024-09-11T14:16:01.508423+0000","last_became_peered":"2024-09-11T14:16:01.508423+0000","last_unstale":"2024-09-11T14:29:55.511420+0000","last_undegraded":"2024-09-11T14:29:55.511420+0000","last_fullsized":"2024-09-11T14:29:55.511420+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523289+0000","last_change":"2024-09-11T14:16:01.528298+0000","last_active":"2024-09-11T14:29:55.523289+0000","last_peered":"2024-09-11T14:29:55.523289+0000","last_clean":"2024-09-11T14:29:55.523289+0000","last_became_active":"2024-09-11T14:16:01.505280+0000","last_became_peered":"2024-09-11T14:16:01.505280+0000","last_unstale":"2024-09-11T14:29:55.523289+0000","last_undegraded":"2024-09-11T14:29:55.523289+0000","last_fullsized":"2024-09-11T14:29:55.523289+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511025+0000","last_change":"2024-09-11T14:16:01.582504+0000","last_active":"2024-09-11T14:29:55.511025+0000","last_peered":"2024-09-11T14:29:55.511025+0000","last_clean":"2024-09-11T14:29:55.511025+0000","last_became_active":"2024-09-11T14:16:01.573403+0000","last_became_peered":"2024-09-11T14:16:01.573403+0000","last_unstale":"2024-09-11T14:29:55.511025+0000","last_undegraded":"2024-09-11T14:29:55.511025+0000","last_fullsized":"2024-09-11T14:29:55.511025+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.525031+0000","last_change":"2024-09-11T14:16:01.614988+0000","last_active":"2024-09-11T14:29:55.525031+0000","last_peered":"2024-09-11T14:29:55.525031+0000","last_clean":"2024-09-11T14:29:55.525031+0000","last_became_active":"2024-09-11T14:16:01.607437+0000","last_became_peered":"2024-09-11T14:16:01.607437+0000","last_unstale":"2024-09-11T14:29:55.525031+0000","last_undegraded":"2024-09-11T14:29:55.525031+0000","last_fullsized":"2024-09-11T14:29:55.525031+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.517913+0000","last_change":"2024-09-11T14:16:01.537504+0000","last_active":"2024-09-11T14:29:55.517913+0000","last_peered":"2024-09-11T14:29:55.517913+0000","last_clean":"2024-09-11T14:29:55.517913+0000","last_became_active":"2024-09-11T14:16:01.520713+0000","last_became_peered":"2024-09-11T14:16:01.520713+0000","last_unstale":"2024-09-11T14:29:55.517913+0000","last_undegraded":"2024-09-11T14:29:55.517913+0000","last_fullsized":"2024-09-11T14:29:55.517913+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.509228+0000","last_change":"2024-09-11T14:16:01.486527+0000","last_active":"2024-09-11T14:29:55.509228+0000","last_peered":"2024-09-11T14:29:55.509228+0000","last_clean":"2024-09-11T14:29:55.509228+0000","last_became_active":"2024-09-11T14:16:01.470273+0000","last_became_peered":"2024-09-11T14:16:01.470273+0000","last_unstale":"2024-09-11T14:29:55.509228+0000","last_undegraded":"2024-09-11T14:29:55.509228+0000","last_fullsized":"2024-09-11T14:29:55.509228+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1467,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515484+0000","last_change":"2024-09-11T14:16:01.518850+0000","last_active":"2024-09-11T14:29:55.515484+0000","last_peered":"2024-09-11T14:29:55.515484+0000","last_clean":"2024-09-11T14:29:55.515484+0000","last_became_active":"2024-09-11T14:16:01.504043+0000","last_became_peered":"2024-09-11T14:16:01.504043+0000","last_unstale":"2024-09-11T14:29:55.515484+0000","last_undegraded":"2024-09-11T14:29:55.515484+0000","last_fullsized":"2024-09-11T14:29:55.515484+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.502154+0000","last_change":"2024-09-11T14:16:01.490663+0000","last_active":"2024-09-11T14:29:55.502154+0000","last_peered":"2024-09-11T14:29:55.502154+0000","last_clean":"2024-09-11T14:29:55.502154+0000","last_became_active":"2024-09-11T14:16:01.479206+0000","last_became_peered":"2024-09-11T14:16:01.479206+0000","last_unstale":"2024-09-11T14:29:55.502154+0000","last_undegraded":"2024-09-11T14:29:55.502154+0000","last_fullsized":"2024-09-11T14:29:55.502154+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506288+0000","last_change":"2024-09-11T14:11:01.590400+0000","last_active":"2024-09-11T14:29:55.506288+0000","last_peered":"2024-09-11T14:29:55.506288+0000","last_clean":"2024-09-11T14:29:55.506288+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:29:55.506288+0000","last_undegraded":"2024-09-11T14:29:55.506288+0000","last_fullsized":"2024-09-11T14:29:55.506288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491586+0000","last_change":"2024-09-11T14:11:01.587732+0000","last_active":"2024-09-11T14:29:55.491586+0000","last_peered":"2024-09-11T14:29:55.491586+0000","last_clean":"2024-09-11T14:29:55.491586+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:29:55.491586+0000","last_undegraded":"2024-09-11T14:29:55.491586+0000","last_fullsized":"2024-09-11T14:29:55.491586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506562+0000","last_change":"2024-09-11T14:11:01.587844+0000","last_active":"2024-09-11T14:29:55.506562+0000","last_peered":"2024-09-11T14:29:55.506562+0000","last_clean":"2024-09-11T14:29:55.506562+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:29:55.506562+0000","last_undegraded":"2024-09-11T14:29:55.506562+0000","last_fullsized":"2024-09-11T14:29:55.506562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489183+0000","last_change":"2024-09-11T14:11:01.585502+0000","last_active":"2024-09-11T14:29:55.489183+0000","last_peered":"2024-09-11T14:29:55.489183+0000","last_clean":"2024-09-11T14:29:55.489183+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:29:55.489183+0000","last_undegraded":"2024-09-11T14:29:55.489183+0000","last_fullsized":"2024-09-11T14:29:55.489183+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":2132,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.516852+0000","last_change":"2024-09-11T14:11:01.588321+0000","last_active":"2024-09-11T14:29:55.516852+0000","last_peered":"2024-09-11T14:29:55.516852+0000","last_clean":"2024-09-11T14:29:55.516852+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:29:55.516852+0000","last_undegraded":"2024-09-11T14:29:55.516852+0000","last_fullsized":"2024-09-11T14:29:55.516852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497120+0000","last_change":"2024-09-11T14:11:01.587060+0000","last_active":"2024-09-11T14:29:55.497120+0000","last_peered":"2024-09-11T14:29:55.497120+0000","last_clean":"2024-09-11T14:29:55.497120+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:29:55.497120+0000","last_undegraded":"2024-09-11T14:29:55.497120+0000","last_fullsized":"2024-09-11T14:29:55.497120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.536047+0000","last_change":"2024-09-11T14:11:01.589239+0000","last_active":"2024-09-11T14:29:55.536047+0000","last_peered":"2024-09-11T14:29:55.536047+0000","last_clean":"2024-09-11T14:29:55.536047+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:29:55.536047+0000","last_undegraded":"2024-09-11T14:29:55.536047+0000","last_fullsized":"2024-09-11T14:29:55.536047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":2131,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506831+0000","last_change":"2024-09-11T14:11:01.590912+0000","last_active":"2024-09-11T14:29:55.506831+0000","last_peered":"2024-09-11T14:29:55.506831+0000","last_clean":"2024-09-11T14:29:55.506831+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:29:55.506831+0000","last_undegraded":"2024-09-11T14:29:55.506831+0000","last_fullsized":"2024-09-11T14:29:55.506831+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2199,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489882+0000","last_change":"2024-09-11T14:10:58.605266+0000","last_active":"2024-09-11T14:29:55.489882+0000","last_peered":"2024-09-11T14:29:55.489882+0000","last_clean":"2024-09-11T14:29:55.489882+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:29:55.489882+0000","last_undegraded":"2024-09-11T14:29:55.489882+0000","last_fullsized":"2024-09-11T14:29:55.489882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70724,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301116,"statfs":{"total":96636764160,"available":96564342784,"internally_reserved":0,"allocated":3710976,"data_stored":2103141,"data_compressed":106589,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66488,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305352,"statfs":{"total":96636764160,"available":96568680448,"internally_reserved":0,"allocated":3645440,"data_stored":1500020,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60904,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310936,"statfs":{"total":96636764160,"available":96574398464,"internally_reserved":0,"allocated":3629056,"data_stored":1487224,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61012,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310828,"statfs":{"total":96636764160,"available":96574287872,"internally_reserved":0,"allocated":3739648,"data_stored":2120340,"data_compressed":112477,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:29:57.498 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:29:57.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.601+0000 7f1a95111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:57.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.606+0000 7f1a95111640 1 Processor -- start 2024-09-11T14:29:57.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.606+0000 7f1a95111640 1 -- start start 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a95111640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1a9009d160 0x7f1a90138f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a95111640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a900a48c0 con 0x7f1a9009dad0 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a95111640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9006d1d0 con 0x7f1a9009d160 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1a9009d160 0x7f1a90138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1a9009dad0 0x7f1a9009ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52408/0 (socket says 172.21.15.97:52408) 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8ed9d640 1 -- 172.21.15.97:0/2623248962 learned_addr learned my addr 172.21.15.97:0/2623248962 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8dd9b640 1 -- 172.21.15.97:0/2623248962 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604045242 0 0) 0x7f1a900a48c0 con 0x7f1a9009dad0 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8dd9b640 1 -- 172.21.15.97:0/2623248962 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a78003580 con 0x7f1a9009dad0 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8e59c640 1 -- 172.21.15.97:0/2623248962 >> v1:172.21.15.97:6789/0 conn(0x7f1a9009dad0 legacy=0x7f1a9009ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8e59c640 1 -- 172.21.15.97:0/2623248962 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900a45b0 con 0x7f1a9009d160 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8e59c640 1 --2- 172.21.15.97:0/2623248962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90138f10 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebb79349138f290 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8dd9b640 1 -- 172.21.15.97:0/2623248962 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a84009d80 con 0x7f1a9009d160 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8dd9b640 1 -- 172.21.15.97:0/2623248962 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a8400e230 con 0x7f1a9009d160 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.607+0000 7f1a8dd9b640 1 -- 172.21.15.97:0/2623248962 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a8400e4d0 con 0x7f1a9009d160 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 1 -- 172.21.15.97:0/2623248962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 msgr2=0x7f1a90138f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 1 --2- 172.21.15.97:0/2623248962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90138f10 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 1 -- 172.21.15.97:0/2623248962 shutdown_connections 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 1 --2- 172.21.15.97:0/2623248962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90138f10 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 1 -- 172.21.15.97:0/2623248962 >> 172.21.15.97:0/2623248962 conn(0x7f1a900a2970 msgr2=0x7f1a900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 1 -- 172.21.15.97:0/2623248962 shutdown_connections 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 1 -- 172.21.15.97:0/2623248962 wait complete. 2024-09-11T14:29:57.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.608+0000 7f1a95111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:57.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.610+0000 7f1a95111640 1 Processor -- start 2024-09-11T14:29:57.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.610+0000 7f1a95111640 1 -- start start 2024-09-11T14:29:57.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.611+0000 7f1a95111640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.611+0000 7f1a95111640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1a901313d0 con 0x7f1a9009d160 2024-09-11T14:29:57.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.611+0000 7f1a8ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.611+0000 7f1a8ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90120830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56426/0 (socket says 172.21.15.97:56426) 2024-09-11T14:29:57.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.611+0000 7f1a8ed9d640 1 -- 172.21.15.97:0/3904421489 learned_addr learned my addr 172.21.15.97:0/3904421489 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:57.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.612+0000 7f1a8ed9d640 1 -- 172.21.15.97:0/3904421489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a90120370 con 0x7f1a9009d160 2024-09-11T14:29:57.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.612+0000 7f1a8ed9d640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90120830 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.612+0000 7f1a777fe640 1 -- 172.21.15.97:0/3904421489 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a80005a60 con 0x7f1a9009d160 2024-09-11T14:29:57.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.612+0000 7f1a777fe640 1 -- 172.21.15.97:0/3904421489 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a80005bc0 con 0x7f1a9009d160 2024-09-11T14:29:57.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.612+0000 7f1a777fe640 1 -- 172.21.15.97:0/3904421489 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a80005e60 con 0x7f1a9009d160 2024-09-11T14:29:57.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.612+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a90123d80 con 0x7f1a9009d160 2024-09-11T14:29:57.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.612+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9011ffd0 con 0x7f1a9009d160 2024-09-11T14:29:57.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.613+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a9009dad0 con 0x7f1a9009d160 2024-09-11T14:29:57.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.613+0000 7f1a777fe640 1 -- 172.21.15.97:0/3904421489 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1a8000c7f0 con 0x7f1a9009d160 2024-09-11T14:29:57.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.613+0000 7f1a777fe640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1a7c03e930 0x7f1a7c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.613+0000 7f1a777fe640 1 -- 172.21.15.97:0/3904421489 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f1a8004f8b0 con 0x7f1a9009d160 2024-09-11T14:29:57.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.614+0000 7f1a8e59c640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1a7c03e930 0x7f1a7c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.614+0000 7f1a8e59c640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1a7c03e930 0x7f1a7c040e40 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.618+0000 7f1a777fe640 1 -- 172.21.15.97:0/3904421489 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1a8000dc10 con 0x7f1a9009d160 2024-09-11T14:29:57.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.791+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a9009d570 con 0x7f1a7c03e930 2024-09-11T14:29:57.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.794+0000 7f1a777fe640 1 -- 172.21.15.97:0/3904421489 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109237 (crc 0 0 0) 0x7f1a84009cd0 con 0x7f1a7c03e930 2024-09-11T14:29:57.796 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:29:57.797 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:29:57.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1a7c03e930 msgr2=0x7f1a7c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1a7c03e930 0x7f1a7c040e40 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 msgr2=0x7f1a90120830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90120830 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 shutdown_connections 2024-09-11T14:29:57.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1a7c03e930 0x7f1a7c040e40 unknown :-1 s=CLOSED pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 --2- 172.21.15.97:0/3904421489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a9009d160 0x7f1a90120830 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 >> 172.21.15.97:0/3904421489 conn(0x7f1a900a2970 msgr2=0x7f1a9009fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:57.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 shutdown_connections 2024-09-11T14:29:57.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.796+0000 7f1a95111640 1 -- 172.21.15.97:0/3904421489 wait complete. 2024-09-11T14:29:57.809 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1283,"stamp":"2024-09-11T14:29:56.798172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259128,"kb_used_data":14380,"kb_used_omap":0,"kb_used_meta":244672,"kb_avail":377228232,"statfs":{"total":386547056640,"available":386281709568,"internally_reserved":0,"allocated":14725120,"data_stored":7210725,"data_compressed":354490,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":250544128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001990"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504619+0000","last_change":"2024-09-11T14:16:01.478105+0000","last_active":"2024-09-11T14:29:55.504619+0000","last_peered":"2024-09-11T14:29:55.504619+0000","last_clean":"2024-09-11T14:29:55.504619+0000","last_became_active":"2024-09-11T14:16:01.469796+0000","last_became_peered":"2024-09-11T14:16:01.469796+0000","last_unstale":"2024-09-11T14:29:55.504619+0000","last_undegraded":"2024-09-11T14:29:55.504619+0000","last_fullsized":"2024-09-11T14:29:55.504619+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.505673+0000","last_change":"2024-09-11T14:16:01.566671+0000","last_active":"2024-09-11T14:29:55.505673+0000","last_peered":"2024-09-11T14:29:55.505673+0000","last_clean":"2024-09-11T14:29:55.505673+0000","last_became_active":"2024-09-11T14:16:01.553483+0000","last_became_peered":"2024-09-11T14:16:01.553483+0000","last_unstale":"2024-09-11T14:29:55.505673+0000","last_undegraded":"2024-09-11T14:29:55.505673+0000","last_fullsized":"2024-09-11T14:29:55.505673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.500570+0000","last_change":"2024-09-11T14:16:01.491814+0000","last_active":"2024-09-11T14:29:55.500570+0000","last_peered":"2024-09-11T14:29:55.500570+0000","last_clean":"2024-09-11T14:29:55.500570+0000","last_became_active":"2024-09-11T14:16:01.485851+0000","last_became_peered":"2024-09-11T14:16:01.485851+0000","last_unstale":"2024-09-11T14:29:55.500570+0000","last_undegraded":"2024-09-11T14:29:55.500570+0000","last_fullsized":"2024-09-11T14:29:55.500570+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.488003+0000","last_change":"2024-09-11T14:16:01.497743+0000","last_active":"2024-09-11T14:29:55.488003+0000","last_peered":"2024-09-11T14:29:55.488003+0000","last_clean":"2024-09-11T14:29:55.488003+0000","last_became_active":"2024-09-11T14:16:01.469079+0000","last_became_peered":"2024-09-11T14:16:01.469079+0000","last_unstale":"2024-09-11T14:29:55.488003+0000","last_undegraded":"2024-09-11T14:29:55.488003+0000","last_fullsized":"2024-09-11T14:29:55.488003+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489764+0000","last_change":"2024-09-11T14:16:01.492881+0000","last_active":"2024-09-11T14:29:55.489764+0000","last_peered":"2024-09-11T14:29:55.489764+0000","last_clean":"2024-09-11T14:29:55.489764+0000","last_became_active":"2024-09-11T14:16:01.480473+0000","last_became_peered":"2024-09-11T14:16:01.480473+0000","last_unstale":"2024-09-11T14:29:55.489764+0000","last_undegraded":"2024-09-11T14:29:55.489764+0000","last_fullsized":"2024-09-11T14:29:55.489764+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.490446+0000","last_change":"2024-09-11T14:16:01.541899+0000","last_active":"2024-09-11T14:29:55.490446+0000","last_peered":"2024-09-11T14:29:55.490446+0000","last_clean":"2024-09-11T14:29:55.490446+0000","last_became_active":"2024-09-11T14:16:01.515259+0000","last_became_peered":"2024-09-11T14:16:01.515259+0000","last_unstale":"2024-09-11T14:29:55.490446+0000","last_undegraded":"2024-09-11T14:29:55.490446+0000","last_fullsized":"2024-09-11T14:29:55.490446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515043+0000","last_change":"2024-09-11T14:16:01.523684+0000","last_active":"2024-09-11T14:29:55.515043+0000","last_peered":"2024-09-11T14:29:55.515043+0000","last_clean":"2024-09-11T14:29:55.515043+0000","last_became_active":"2024-09-11T14:16:01.510524+0000","last_became_peered":"2024-09-11T14:16:01.510524+0000","last_unstale":"2024-09-11T14:29:55.515043+0000","last_undegraded":"2024-09-11T14:29:55.515043+0000","last_fullsized":"2024-09-11T14:29:55.515043+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523629+0000","last_change":"2024-09-11T14:16:01.525329+0000","last_active":"2024-09-11T14:29:55.523629+0000","last_peered":"2024-09-11T14:29:55.523629+0000","last_clean":"2024-09-11T14:29:55.523629+0000","last_became_active":"2024-09-11T14:16:01.514773+0000","last_became_peered":"2024-09-11T14:16:01.514773+0000","last_unstale":"2024-09-11T14:29:55.523629+0000","last_undegraded":"2024-09-11T14:29:55.523629+0000","last_fullsized":"2024-09-11T14:29:55.523629+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.498084+0000","last_change":"2024-09-11T14:16:01.533436+0000","last_active":"2024-09-11T14:29:55.498084+0000","last_peered":"2024-09-11T14:29:55.498084+0000","last_clean":"2024-09-11T14:29:55.498084+0000","last_became_active":"2024-09-11T14:16:01.525822+0000","last_became_peered":"2024-09-11T14:16:01.525822+0000","last_unstale":"2024-09-11T14:29:55.498084+0000","last_undegraded":"2024-09-11T14:29:55.498084+0000","last_fullsized":"2024-09-11T14:29:55.498084+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.487709+0000","last_change":"2024-09-11T14:16:01.514314+0000","last_active":"2024-09-11T14:29:55.487709+0000","last_peered":"2024-09-11T14:29:55.487709+0000","last_clean":"2024-09-11T14:29:55.487709+0000","last_became_active":"2024-09-11T14:16:01.499412+0000","last_became_peered":"2024-09-11T14:16:01.499412+0000","last_unstale":"2024-09-11T14:29:55.487709+0000","last_undegraded":"2024-09-11T14:29:55.487709+0000","last_fullsized":"2024-09-11T14:29:55.487709+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.507704+0000","last_change":"2024-09-11T14:16:01.517824+0000","last_active":"2024-09-11T14:29:55.507704+0000","last_peered":"2024-09-11T14:29:55.507704+0000","last_clean":"2024-09-11T14:29:55.507704+0000","last_became_active":"2024-09-11T14:16:01.507489+0000","last_became_peered":"2024-09-11T14:16:01.507489+0000","last_unstale":"2024-09-11T14:29:55.507704+0000","last_undegraded":"2024-09-11T14:29:55.507704+0000","last_fullsized":"2024-09-11T14:29:55.507704+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523786+0000","last_change":"2024-09-11T14:16:01.572297+0000","last_active":"2024-09-11T14:29:55.523786+0000","last_peered":"2024-09-11T14:29:55.523786+0000","last_clean":"2024-09-11T14:29:55.523786+0000","last_became_active":"2024-09-11T14:16:01.564983+0000","last_became_peered":"2024-09-11T14:16:01.564983+0000","last_unstale":"2024-09-11T14:29:55.523786+0000","last_undegraded":"2024-09-11T14:29:55.523786+0000","last_fullsized":"2024-09-11T14:29:55.523786+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.492434+0000","last_change":"2024-09-11T14:16:01.553374+0000","last_active":"2024-09-11T14:29:55.492434+0000","last_peered":"2024-09-11T14:29:55.492434+0000","last_clean":"2024-09-11T14:29:55.492434+0000","last_became_active":"2024-09-11T14:16:01.546695+0000","last_became_peered":"2024-09-11T14:16:01.546695+0000","last_unstale":"2024-09-11T14:29:55.492434+0000","last_undegraded":"2024-09-11T14:29:55.492434+0000","last_fullsized":"2024-09-11T14:29:55.492434+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.494645+0000","last_change":"2024-09-11T14:16:01.549306+0000","last_active":"2024-09-11T14:29:55.494645+0000","last_peered":"2024-09-11T14:29:55.494645+0000","last_clean":"2024-09-11T14:29:55.494645+0000","last_became_active":"2024-09-11T14:16:01.541719+0000","last_became_peered":"2024-09-11T14:16:01.541719+0000","last_unstale":"2024-09-11T14:29:55.494645+0000","last_undegraded":"2024-09-11T14:29:55.494645+0000","last_fullsized":"2024-09-11T14:29:55.494645+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511367+0000","last_change":"2024-09-11T14:16:01.609878+0000","last_active":"2024-09-11T14:29:55.511367+0000","last_peered":"2024-09-11T14:29:55.511367+0000","last_clean":"2024-09-11T14:29:55.511367+0000","last_became_active":"2024-09-11T14:16:01.598547+0000","last_became_peered":"2024-09-11T14:16:01.598547+0000","last_unstale":"2024-09-11T14:29:55.511367+0000","last_undegraded":"2024-09-11T14:29:55.511367+0000","last_fullsized":"2024-09-11T14:29:55.511367+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.493382+0000","last_change":"2024-09-11T14:16:01.555603+0000","last_active":"2024-09-11T14:29:55.493382+0000","last_peered":"2024-09-11T14:29:55.493382+0000","last_clean":"2024-09-11T14:29:55.493382+0000","last_became_active":"2024-09-11T14:16:01.528427+0000","last_became_peered":"2024-09-11T14:16:01.528427+0000","last_unstale":"2024-09-11T14:29:55.493382+0000","last_undegraded":"2024-09-11T14:29:55.493382+0000","last_fullsized":"2024-09-11T14:29:55.493382+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.532842+0000","last_change":"2024-09-11T14:16:01.556304+0000","last_active":"2024-09-11T14:29:55.532842+0000","last_peered":"2024-09-11T14:29:55.532842+0000","last_clean":"2024-09-11T14:29:55.532842+0000","last_became_active":"2024-09-11T14:16:01.540687+0000","last_became_peered":"2024-09-11T14:16:01.540687+0000","last_unstale":"2024-09-11T14:29:55.532842+0000","last_undegraded":"2024-09-11T14:29:55.532842+0000","last_fullsized":"2024-09-11T14:29:55.532842+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497272+0000","last_change":"2024-09-11T14:16:01.494968+0000","last_active":"2024-09-11T14:29:55.497272+0000","last_peered":"2024-09-11T14:29:55.497272+0000","last_clean":"2024-09-11T14:29:55.497272+0000","last_became_active":"2024-09-11T14:16:01.475901+0000","last_became_peered":"2024-09-11T14:16:01.475901+0000","last_unstale":"2024-09-11T14:29:55.497272+0000","last_undegraded":"2024-09-11T14:29:55.497272+0000","last_fullsized":"2024-09-11T14:29:55.497272+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504034+0000","last_change":"2024-09-11T14:16:01.496009+0000","last_active":"2024-09-11T14:29:55.504034+0000","last_peered":"2024-09-11T14:29:55.504034+0000","last_clean":"2024-09-11T14:29:55.504034+0000","last_became_active":"2024-09-11T14:16:01.485861+0000","last_became_peered":"2024-09-11T14:16:01.485861+0000","last_unstale":"2024-09-11T14:29:55.504034+0000","last_undegraded":"2024-09-11T14:29:55.504034+0000","last_fullsized":"2024-09-11T14:29:55.504034+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503865+0000","last_change":"2024-09-11T14:16:01.511330+0000","last_active":"2024-09-11T14:29:55.503865+0000","last_peered":"2024-09-11T14:29:55.503865+0000","last_clean":"2024-09-11T14:29:55.503865+0000","last_became_active":"2024-09-11T14:16:01.497752+0000","last_became_peered":"2024-09-11T14:16:01.497752+0000","last_unstale":"2024-09-11T14:29:55.503865+0000","last_undegraded":"2024-09-11T14:29:55.503865+0000","last_fullsized":"2024-09-11T14:29:55.503865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503010+0000","last_change":"2024-09-11T14:16:01.548238+0000","last_active":"2024-09-11T14:29:55.503010+0000","last_peered":"2024-09-11T14:29:55.503010+0000","last_clean":"2024-09-11T14:29:55.503010+0000","last_became_active":"2024-09-11T14:16:01.540272+0000","last_became_peered":"2024-09-11T14:16:01.540272+0000","last_unstale":"2024-09-11T14:29:55.503010+0000","last_undegraded":"2024-09-11T14:29:55.503010+0000","last_fullsized":"2024-09-11T14:29:55.503010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491594+0000","last_change":"2024-09-11T14:16:01.530012+0000","last_active":"2024-09-11T14:29:55.491594+0000","last_peered":"2024-09-11T14:29:55.491594+0000","last_clean":"2024-09-11T14:29:55.491594+0000","last_became_active":"2024-09-11T14:16:01.516906+0000","last_became_peered":"2024-09-11T14:16:01.516906+0000","last_unstale":"2024-09-11T14:29:55.491594+0000","last_undegraded":"2024-09-11T14:29:55.491594+0000","last_fullsized":"2024-09-11T14:29:55.491594+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.501848+0000","last_change":"2024-09-11T14:16:01.535163+0000","last_active":"2024-09-11T14:29:55.501848+0000","last_peered":"2024-09-11T14:29:55.501848+0000","last_clean":"2024-09-11T14:29:55.501848+0000","last_became_active":"2024-09-11T14:16:01.524168+0000","last_became_peered":"2024-09-11T14:16:01.524168+0000","last_unstale":"2024-09-11T14:29:55.501848+0000","last_undegraded":"2024-09-11T14:29:55.501848+0000","last_fullsized":"2024-09-11T14:29:55.501848+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.520363+0000","last_change":"2024-09-11T14:16:01.525020+0000","last_active":"2024-09-11T14:29:55.520363+0000","last_peered":"2024-09-11T14:29:55.520363+0000","last_clean":"2024-09-11T14:29:55.520363+0000","last_became_active":"2024-09-11T14:16:01.519043+0000","last_became_peered":"2024-09-11T14:16:01.519043+0000","last_unstale":"2024-09-11T14:29:55.520363+0000","last_undegraded":"2024-09-11T14:29:55.520363+0000","last_fullsized":"2024-09-11T14:29:55.520363+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511420+0000","last_change":"2024-09-11T14:16:01.514997+0000","last_active":"2024-09-11T14:29:55.511420+0000","last_peered":"2024-09-11T14:29:55.511420+0000","last_clean":"2024-09-11T14:29:55.511420+0000","last_became_active":"2024-09-11T14:16:01.508423+0000","last_became_peered":"2024-09-11T14:16:01.508423+0000","last_unstale":"2024-09-11T14:29:55.511420+0000","last_undegraded":"2024-09-11T14:29:55.511420+0000","last_fullsized":"2024-09-11T14:29:55.511420+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523289+0000","last_change":"2024-09-11T14:16:01.528298+0000","last_active":"2024-09-11T14:29:55.523289+0000","last_peered":"2024-09-11T14:29:55.523289+0000","last_clean":"2024-09-11T14:29:55.523289+0000","last_became_active":"2024-09-11T14:16:01.505280+0000","last_became_peered":"2024-09-11T14:16:01.505280+0000","last_unstale":"2024-09-11T14:29:55.523289+0000","last_undegraded":"2024-09-11T14:29:55.523289+0000","last_fullsized":"2024-09-11T14:29:55.523289+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511025+0000","last_change":"2024-09-11T14:16:01.582504+0000","last_active":"2024-09-11T14:29:55.511025+0000","last_peered":"2024-09-11T14:29:55.511025+0000","last_clean":"2024-09-11T14:29:55.511025+0000","last_became_active":"2024-09-11T14:16:01.573403+0000","last_became_peered":"2024-09-11T14:16:01.573403+0000","last_unstale":"2024-09-11T14:29:55.511025+0000","last_undegraded":"2024-09-11T14:29:55.511025+0000","last_fullsized":"2024-09-11T14:29:55.511025+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.525031+0000","last_change":"2024-09-11T14:16:01.614988+0000","last_active":"2024-09-11T14:29:55.525031+0000","last_peered":"2024-09-11T14:29:55.525031+0000","last_clean":"2024-09-11T14:29:55.525031+0000","last_became_active":"2024-09-11T14:16:01.607437+0000","last_became_peered":"2024-09-11T14:16:01.607437+0000","last_unstale":"2024-09-11T14:29:55.525031+0000","last_undegraded":"2024-09-11T14:29:55.525031+0000","last_fullsized":"2024-09-11T14:29:55.525031+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.517913+0000","last_change":"2024-09-11T14:16:01.537504+0000","last_active":"2024-09-11T14:29:55.517913+0000","last_peered":"2024-09-11T14:29:55.517913+0000","last_clean":"2024-09-11T14:29:55.517913+0000","last_became_active":"2024-09-11T14:16:01.520713+0000","last_became_peered":"2024-09-11T14:16:01.520713+0000","last_unstale":"2024-09-11T14:29:55.517913+0000","last_undegraded":"2024-09-11T14:29:55.517913+0000","last_fullsized":"2024-09-11T14:29:55.517913+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.509228+0000","last_change":"2024-09-11T14:16:01.486527+0000","last_active":"2024-09-11T14:29:55.509228+0000","last_peered":"2024-09-11T14:29:55.509228+0000","last_clean":"2024-09-11T14:29:55.509228+0000","last_became_active":"2024-09-11T14:16:01.470273+0000","last_became_peered":"2024-09-11T14:16:01.470273+0000","last_unstale":"2024-09-11T14:29:55.509228+0000","last_undegraded":"2024-09-11T14:29:55.509228+0000","last_fullsized":"2024-09-11T14:29:55.509228+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1467,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515484+0000","last_change":"2024-09-11T14:16:01.518850+0000","last_active":"2024-09-11T14:29:55.515484+0000","last_peered":"2024-09-11T14:29:55.515484+0000","last_clean":"2024-09-11T14:29:55.515484+0000","last_became_active":"2024-09-11T14:16:01.504043+0000","last_became_peered":"2024-09-11T14:16:01.504043+0000","last_unstale":"2024-09-11T14:29:55.515484+0000","last_undegraded":"2024-09-11T14:29:55.515484+0000","last_fullsized":"2024-09-11T14:29:55.515484+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.502154+0000","last_change":"2024-09-11T14:16:01.490663+0000","last_active":"2024-09-11T14:29:55.502154+0000","last_peered":"2024-09-11T14:29:55.502154+0000","last_clean":"2024-09-11T14:29:55.502154+0000","last_became_active":"2024-09-11T14:16:01.479206+0000","last_became_peered":"2024-09-11T14:16:01.479206+0000","last_unstale":"2024-09-11T14:29:55.502154+0000","last_undegraded":"2024-09-11T14:29:55.502154+0000","last_fullsized":"2024-09-11T14:29:55.502154+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506288+0000","last_change":"2024-09-11T14:11:01.590400+0000","last_active":"2024-09-11T14:29:55.506288+0000","last_peered":"2024-09-11T14:29:55.506288+0000","last_clean":"2024-09-11T14:29:55.506288+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:29:55.506288+0000","last_undegraded":"2024-09-11T14:29:55.506288+0000","last_fullsized":"2024-09-11T14:29:55.506288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491586+0000","last_change":"2024-09-11T14:11:01.587732+0000","last_active":"2024-09-11T14:29:55.491586+0000","last_peered":"2024-09-11T14:29:55.491586+0000","last_clean":"2024-09-11T14:29:55.491586+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:29:55.491586+0000","last_undegraded":"2024-09-11T14:29:55.491586+0000","last_fullsized":"2024-09-11T14:29:55.491586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506562+0000","last_change":"2024-09-11T14:11:01.587844+0000","last_active":"2024-09-11T14:29:55.506562+0000","last_peered":"2024-09-11T14:29:55.506562+0000","last_clean":"2024-09-11T14:29:55.506562+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:29:55.506562+0000","last_undegraded":"2024-09-11T14:29:55.506562+0000","last_fullsized":"2024-09-11T14:29:55.506562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489183+0000","last_change":"2024-09-11T14:11:01.585502+0000","last_active":"2024-09-11T14:29:55.489183+0000","last_peered":"2024-09-11T14:29:55.489183+0000","last_clean":"2024-09-11T14:29:55.489183+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:29:55.489183+0000","last_undegraded":"2024-09-11T14:29:55.489183+0000","last_fullsized":"2024-09-11T14:29:55.489183+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":2132,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.516852+0000","last_change":"2024-09-11T14:11:01.588321+0000","last_active":"2024-09-11T14:29:55.516852+0000","last_peered":"2024-09-11T14:29:55.516852+0000","last_clean":"2024-09-11T14:29:55.516852+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:29:55.516852+0000","last_undegraded":"2024-09-11T14:29:55.516852+0000","last_fullsized":"2024-09-11T14:29:55.516852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497120+0000","last_change":"2024-09-11T14:11:01.587060+0000","last_active":"2024-09-11T14:29:55.497120+0000","last_peered":"2024-09-11T14:29:55.497120+0000","last_clean":"2024-09-11T14:29:55.497120+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:29:55.497120+0000","last_undegraded":"2024-09-11T14:29:55.497120+0000","last_fullsized":"2024-09-11T14:29:55.497120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.536047+0000","last_change":"2024-09-11T14:11:01.589239+0000","last_active":"2024-09-11T14:29:55.536047+0000","last_peered":"2024-09-11T14:29:55.536047+0000","last_clean":"2024-09-11T14:29:55.536047+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:29:55.536047+0000","last_undegraded":"2024-09-11T14:29:55.536047+0000","last_fullsized":"2024-09-11T14:29:55.536047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":2131,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506831+0000","last_change":"2024-09-11T14:11:01.590912+0000","last_active":"2024-09-11T14:29:55.506831+0000","last_peered":"2024-09-11T14:29:55.506831+0000","last_clean":"2024-09-11T14:29:55.506831+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:29:55.506831+0000","last_undegraded":"2024-09-11T14:29:55.506831+0000","last_fullsized":"2024-09-11T14:29:55.506831+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2199,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489882+0000","last_change":"2024-09-11T14:10:58.605266+0000","last_active":"2024-09-11T14:29:55.489882+0000","last_peered":"2024-09-11T14:29:55.489882+0000","last_clean":"2024-09-11T14:29:55.489882+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:29:55.489882+0000","last_undegraded":"2024-09-11T14:29:55.489882+0000","last_fullsized":"2024-09-11T14:29:55.489882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70724,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301116,"statfs":{"total":96636764160,"available":96564342784,"internally_reserved":0,"allocated":3710976,"data_stored":2103141,"data_compressed":106589,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66488,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305352,"statfs":{"total":96636764160,"available":96568680448,"internally_reserved":0,"allocated":3645440,"data_stored":1500020,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60904,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310936,"statfs":{"total":96636764160,"available":96574398464,"internally_reserved":0,"allocated":3629056,"data_stored":1487224,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61012,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310828,"statfs":{"total":96636764160,"available":96574287872,"internally_reserved":0,"allocated":3739648,"data_stored":2120340,"data_compressed":112477,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:29:57.812 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:29:57.813 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:29:57.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.916+0000 7f95e9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:57.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.921+0000 7f95e9751640 1 Processor -- start 2024-09-11T14:29:57.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.921+0000 7f95e9751640 1 -- start start 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e9751640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f95e409d570 0x7f95e413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e9751640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e40a0060 con 0x7f95e409ca50 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e9751640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f95e409fd30 con 0x7f95e409d570 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f95e409ca50 0x7f95e409ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52416/0 (socket says 172.21.15.97:52416) 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e2ffd640 1 -- 172.21.15.97:0/1767627870 learned_addr learned my addr 172.21.15.97:0/1767627870 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e27fc640 1 --2- 172.21.15.97:0/1767627870 >> v2:172.21.15.97:3300/0 conn(0x7f95e409d570 0x7f95e413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e27fc640 1 -- 172.21.15.97:0/1767627870 >> v1:172.21.15.97:6789/0 conn(0x7f95e409ca50 legacy=0x7f95e409ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e27fc640 1 -- 172.21.15.97:0/1767627870 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e409e3c0 con 0x7f95e409d570 2024-09-11T14:29:57.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.922+0000 7f95e1ffb640 1 -- 172.21.15.97:0/1767627870 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019209208 0 0) 0x7f95e40a0060 con 0x7f95e409ca50 2024-09-11T14:29:57.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e27fc640 1 --2- 172.21.15.97:0/1767627870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409d570 0x7f95e413b3b0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d154aa44d5c2db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e1ffb640 1 -- 172.21.15.97:0/1767627870 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f95d8009d80 con 0x7f95e409d570 2024-09-11T14:29:57.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e1ffb640 1 -- 172.21.15.97:0/1767627870 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f95d800e230 con 0x7f95e409d570 2024-09-11T14:29:57.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e1ffb640 1 -- 172.21.15.97:0/1767627870 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f95d800e4d0 con 0x7f95e409d570 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e9751640 1 -- 172.21.15.97:0/1767627870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409d570 msgr2=0x7f95e413b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e9751640 1 --2- 172.21.15.97:0/1767627870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409d570 0x7f95e413b3b0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e9751640 1 -- 172.21.15.97:0/1767627870 shutdown_connections 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e9751640 1 --2- 172.21.15.97:0/1767627870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409d570 0x7f95e413b3b0 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e9751640 1 -- 172.21.15.97:0/1767627870 >> 172.21.15.97:0/1767627870 conn(0x7f95e40a5230 msgr2=0x7f95e40a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e9751640 1 -- 172.21.15.97:0/1767627870 shutdown_connections 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.923+0000 7f95e9751640 1 -- 172.21.15.97:0/1767627870 wait complete. 2024-09-11T14:29:57.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.924+0000 7f95e9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:57.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.925+0000 7f95e9751640 1 Processor -- start 2024-09-11T14:29:57.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.925+0000 7f95e9751640 1 -- start start 2024-09-11T14:29:57.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.926+0000 7f95e9751640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409ca50 0x7f95e4126b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.926+0000 7f95e9751640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f95e4136db0 con 0x7f95e409ca50 2024-09-11T14:29:57.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.926+0000 7f95e2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409ca50 0x7f95e4126b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.926+0000 7f95e2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409ca50 0x7f95e4126b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56446/0 (socket says 172.21.15.97:56446) 2024-09-11T14:29:57.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.926+0000 7f95e2ffd640 1 -- 172.21.15.97:0/3551499444 learned_addr learned my addr 172.21.15.97:0/3551499444 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:57.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.927+0000 7f95e2ffd640 1 -- 172.21.15.97:0/3551499444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e4125450 con 0x7f95e409ca50 2024-09-11T14:29:57.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.927+0000 7f95e2ffd640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409ca50 0x7f95e4126b90 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.927+0000 7f95cb7fe640 1 -- 172.21.15.97:0/3551499444 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f95d4004bc0 con 0x7f95e409ca50 2024-09-11T14:29:57.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.927+0000 7f95cb7fe640 1 -- 172.21.15.97:0/3551499444 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f95d4004d20 con 0x7f95e409ca50 2024-09-11T14:29:57.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.927+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e4124ba0 con 0x7f95e409ca50 2024-09-11T14:29:57.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.927+0000 7f95cb7fe640 1 -- 172.21.15.97:0/3551499444 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f95d4007120 con 0x7f95e409ca50 2024-09-11T14:29:57.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.927+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e4126270 con 0x7f95e409ca50 2024-09-11T14:29:57.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.928+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e40a1ba0 con 0x7f95e409ca50 2024-09-11T14:29:57.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.928+0000 7f95cb7fe640 1 -- 172.21.15.97:0/3551499444 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f95d40072d0 con 0x7f95e409ca50 2024-09-11T14:29:57.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.928+0000 7f95cb7fe640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f95d003e930 0x7f95d0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:57.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.928+0000 7f95cb7fe640 1 -- 172.21.15.97:0/3551499444 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f95d4050230 con 0x7f95e409ca50 2024-09-11T14:29:57.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.929+0000 7f95e27fc640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f95d003e930 0x7f95d0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:57.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.929+0000 7f95e27fc640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f95d003e930 0x7f95d0040e40 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:57.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:57.934+0000 7f95cb7fe640 1 -- 172.21.15.97:0/3551499444 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f95d40066b0 con 0x7f95e409ca50 2024-09-11T14:29:58.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.104+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95e409f9b0 con 0x7f95d003e930 2024-09-11T14:29:58.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.106+0000 7f95cb7fe640 1 -- 172.21.15.97:0/3551499444 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109237 (crc 0 0 0) 0x7f95d8009da0 con 0x7f95d003e930 2024-09-11T14:29:58.108 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:29:58.109 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:29:58.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f95d003e930 msgr2=0x7f95d0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:58.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f95d003e930 0x7f95d0040e40 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409ca50 msgr2=0x7f95e4126b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:58.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409ca50 0x7f95e4126b90 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 shutdown_connections 2024-09-11T14:29:58.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f95d003e930 0x7f95d0040e40 unknown :-1 s=CLOSED pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 --2- 172.21.15.97:0/3551499444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95e409ca50 0x7f95e4126b90 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 >> 172.21.15.97:0/3551499444 conn(0x7f95e40a5230 msgr2=0x7f95e40a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:58.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 shutdown_connections 2024-09-11T14:29:58.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.109+0000 7f95e9751640 1 -- 172.21.15.97:0/3551499444 wait complete. 2024-09-11T14:29:58.121 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1283,"stamp":"2024-09-11T14:29:56.798172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259128,"kb_used_data":14380,"kb_used_omap":0,"kb_used_meta":244672,"kb_avail":377228232,"statfs":{"total":386547056640,"available":386281709568,"internally_reserved":0,"allocated":14725120,"data_stored":7210725,"data_compressed":354490,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":250544128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001990"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504619+0000","last_change":"2024-09-11T14:16:01.478105+0000","last_active":"2024-09-11T14:29:55.504619+0000","last_peered":"2024-09-11T14:29:55.504619+0000","last_clean":"2024-09-11T14:29:55.504619+0000","last_became_active":"2024-09-11T14:16:01.469796+0000","last_became_peered":"2024-09-11T14:16:01.469796+0000","last_unstale":"2024-09-11T14:29:55.504619+0000","last_undegraded":"2024-09-11T14:29:55.504619+0000","last_fullsized":"2024-09-11T14:29:55.504619+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.505673+0000","last_change":"2024-09-11T14:16:01.566671+0000","last_active":"2024-09-11T14:29:55.505673+0000","last_peered":"2024-09-11T14:29:55.505673+0000","last_clean":"2024-09-11T14:29:55.505673+0000","last_became_active":"2024-09-11T14:16:01.553483+0000","last_became_peered":"2024-09-11T14:16:01.553483+0000","last_unstale":"2024-09-11T14:29:55.505673+0000","last_undegraded":"2024-09-11T14:29:55.505673+0000","last_fullsized":"2024-09-11T14:29:55.505673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.500570+0000","last_change":"2024-09-11T14:16:01.491814+0000","last_active":"2024-09-11T14:29:55.500570+0000","last_peered":"2024-09-11T14:29:55.500570+0000","last_clean":"2024-09-11T14:29:55.500570+0000","last_became_active":"2024-09-11T14:16:01.485851+0000","last_became_peered":"2024-09-11T14:16:01.485851+0000","last_unstale":"2024-09-11T14:29:55.500570+0000","last_undegraded":"2024-09-11T14:29:55.500570+0000","last_fullsized":"2024-09-11T14:29:55.500570+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.488003+0000","last_change":"2024-09-11T14:16:01.497743+0000","last_active":"2024-09-11T14:29:55.488003+0000","last_peered":"2024-09-11T14:29:55.488003+0000","last_clean":"2024-09-11T14:29:55.488003+0000","last_became_active":"2024-09-11T14:16:01.469079+0000","last_became_peered":"2024-09-11T14:16:01.469079+0000","last_unstale":"2024-09-11T14:29:55.488003+0000","last_undegraded":"2024-09-11T14:29:55.488003+0000","last_fullsized":"2024-09-11T14:29:55.488003+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489764+0000","last_change":"2024-09-11T14:16:01.492881+0000","last_active":"2024-09-11T14:29:55.489764+0000","last_peered":"2024-09-11T14:29:55.489764+0000","last_clean":"2024-09-11T14:29:55.489764+0000","last_became_active":"2024-09-11T14:16:01.480473+0000","last_became_peered":"2024-09-11T14:16:01.480473+0000","last_unstale":"2024-09-11T14:29:55.489764+0000","last_undegraded":"2024-09-11T14:29:55.489764+0000","last_fullsized":"2024-09-11T14:29:55.489764+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.490446+0000","last_change":"2024-09-11T14:16:01.541899+0000","last_active":"2024-09-11T14:29:55.490446+0000","last_peered":"2024-09-11T14:29:55.490446+0000","last_clean":"2024-09-11T14:29:55.490446+0000","last_became_active":"2024-09-11T14:16:01.515259+0000","last_became_peered":"2024-09-11T14:16:01.515259+0000","last_unstale":"2024-09-11T14:29:55.490446+0000","last_undegraded":"2024-09-11T14:29:55.490446+0000","last_fullsized":"2024-09-11T14:29:55.490446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515043+0000","last_change":"2024-09-11T14:16:01.523684+0000","last_active":"2024-09-11T14:29:55.515043+0000","last_peered":"2024-09-11T14:29:55.515043+0000","last_clean":"2024-09-11T14:29:55.515043+0000","last_became_active":"2024-09-11T14:16:01.510524+0000","last_became_peered":"2024-09-11T14:16:01.510524+0000","last_unstale":"2024-09-11T14:29:55.515043+0000","last_undegraded":"2024-09-11T14:29:55.515043+0000","last_fullsized":"2024-09-11T14:29:55.515043+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523629+0000","last_change":"2024-09-11T14:16:01.525329+0000","last_active":"2024-09-11T14:29:55.523629+0000","last_peered":"2024-09-11T14:29:55.523629+0000","last_clean":"2024-09-11T14:29:55.523629+0000","last_became_active":"2024-09-11T14:16:01.514773+0000","last_became_peered":"2024-09-11T14:16:01.514773+0000","last_unstale":"2024-09-11T14:29:55.523629+0000","last_undegraded":"2024-09-11T14:29:55.523629+0000","last_fullsized":"2024-09-11T14:29:55.523629+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.498084+0000","last_change":"2024-09-11T14:16:01.533436+0000","last_active":"2024-09-11T14:29:55.498084+0000","last_peered":"2024-09-11T14:29:55.498084+0000","last_clean":"2024-09-11T14:29:55.498084+0000","last_became_active":"2024-09-11T14:16:01.525822+0000","last_became_peered":"2024-09-11T14:16:01.525822+0000","last_unstale":"2024-09-11T14:29:55.498084+0000","last_undegraded":"2024-09-11T14:29:55.498084+0000","last_fullsized":"2024-09-11T14:29:55.498084+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.487709+0000","last_change":"2024-09-11T14:16:01.514314+0000","last_active":"2024-09-11T14:29:55.487709+0000","last_peered":"2024-09-11T14:29:55.487709+0000","last_clean":"2024-09-11T14:29:55.487709+0000","last_became_active":"2024-09-11T14:16:01.499412+0000","last_became_peered":"2024-09-11T14:16:01.499412+0000","last_unstale":"2024-09-11T14:29:55.487709+0000","last_undegraded":"2024-09-11T14:29:55.487709+0000","last_fullsized":"2024-09-11T14:29:55.487709+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.507704+0000","last_change":"2024-09-11T14:16:01.517824+0000","last_active":"2024-09-11T14:29:55.507704+0000","last_peered":"2024-09-11T14:29:55.507704+0000","last_clean":"2024-09-11T14:29:55.507704+0000","last_became_active":"2024-09-11T14:16:01.507489+0000","last_became_peered":"2024-09-11T14:16:01.507489+0000","last_unstale":"2024-09-11T14:29:55.507704+0000","last_undegraded":"2024-09-11T14:29:55.507704+0000","last_fullsized":"2024-09-11T14:29:55.507704+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523786+0000","last_change":"2024-09-11T14:16:01.572297+0000","last_active":"2024-09-11T14:29:55.523786+0000","last_peered":"2024-09-11T14:29:55.523786+0000","last_clean":"2024-09-11T14:29:55.523786+0000","last_became_active":"2024-09-11T14:16:01.564983+0000","last_became_peered":"2024-09-11T14:16:01.564983+0000","last_unstale":"2024-09-11T14:29:55.523786+0000","last_undegraded":"2024-09-11T14:29:55.523786+0000","last_fullsized":"2024-09-11T14:29:55.523786+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.492434+0000","last_change":"2024-09-11T14:16:01.553374+0000","last_active":"2024-09-11T14:29:55.492434+0000","last_peered":"2024-09-11T14:29:55.492434+0000","last_clean":"2024-09-11T14:29:55.492434+0000","last_became_active":"2024-09-11T14:16:01.546695+0000","last_became_peered":"2024-09-11T14:16:01.546695+0000","last_unstale":"2024-09-11T14:29:55.492434+0000","last_undegraded":"2024-09-11T14:29:55.492434+0000","last_fullsized":"2024-09-11T14:29:55.492434+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.494645+0000","last_change":"2024-09-11T14:16:01.549306+0000","last_active":"2024-09-11T14:29:55.494645+0000","last_peered":"2024-09-11T14:29:55.494645+0000","last_clean":"2024-09-11T14:29:55.494645+0000","last_became_active":"2024-09-11T14:16:01.541719+0000","last_became_peered":"2024-09-11T14:16:01.541719+0000","last_unstale":"2024-09-11T14:29:55.494645+0000","last_undegraded":"2024-09-11T14:29:55.494645+0000","last_fullsized":"2024-09-11T14:29:55.494645+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511367+0000","last_change":"2024-09-11T14:16:01.609878+0000","last_active":"2024-09-11T14:29:55.511367+0000","last_peered":"2024-09-11T14:29:55.511367+0000","last_clean":"2024-09-11T14:29:55.511367+0000","last_became_active":"2024-09-11T14:16:01.598547+0000","last_became_peered":"2024-09-11T14:16:01.598547+0000","last_unstale":"2024-09-11T14:29:55.511367+0000","last_undegraded":"2024-09-11T14:29:55.511367+0000","last_fullsized":"2024-09-11T14:29:55.511367+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.493382+0000","last_change":"2024-09-11T14:16:01.555603+0000","last_active":"2024-09-11T14:29:55.493382+0000","last_peered":"2024-09-11T14:29:55.493382+0000","last_clean":"2024-09-11T14:29:55.493382+0000","last_became_active":"2024-09-11T14:16:01.528427+0000","last_became_peered":"2024-09-11T14:16:01.528427+0000","last_unstale":"2024-09-11T14:29:55.493382+0000","last_undegraded":"2024-09-11T14:29:55.493382+0000","last_fullsized":"2024-09-11T14:29:55.493382+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.532842+0000","last_change":"2024-09-11T14:16:01.556304+0000","last_active":"2024-09-11T14:29:55.532842+0000","last_peered":"2024-09-11T14:29:55.532842+0000","last_clean":"2024-09-11T14:29:55.532842+0000","last_became_active":"2024-09-11T14:16:01.540687+0000","last_became_peered":"2024-09-11T14:16:01.540687+0000","last_unstale":"2024-09-11T14:29:55.532842+0000","last_undegraded":"2024-09-11T14:29:55.532842+0000","last_fullsized":"2024-09-11T14:29:55.532842+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497272+0000","last_change":"2024-09-11T14:16:01.494968+0000","last_active":"2024-09-11T14:29:55.497272+0000","last_peered":"2024-09-11T14:29:55.497272+0000","last_clean":"2024-09-11T14:29:55.497272+0000","last_became_active":"2024-09-11T14:16:01.475901+0000","last_became_peered":"2024-09-11T14:16:01.475901+0000","last_unstale":"2024-09-11T14:29:55.497272+0000","last_undegraded":"2024-09-11T14:29:55.497272+0000","last_fullsized":"2024-09-11T14:29:55.497272+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504034+0000","last_change":"2024-09-11T14:16:01.496009+0000","last_active":"2024-09-11T14:29:55.504034+0000","last_peered":"2024-09-11T14:29:55.504034+0000","last_clean":"2024-09-11T14:29:55.504034+0000","last_became_active":"2024-09-11T14:16:01.485861+0000","last_became_peered":"2024-09-11T14:16:01.485861+0000","last_unstale":"2024-09-11T14:29:55.504034+0000","last_undegraded":"2024-09-11T14:29:55.504034+0000","last_fullsized":"2024-09-11T14:29:55.504034+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503865+0000","last_change":"2024-09-11T14:16:01.511330+0000","last_active":"2024-09-11T14:29:55.503865+0000","last_peered":"2024-09-11T14:29:55.503865+0000","last_clean":"2024-09-11T14:29:55.503865+0000","last_became_active":"2024-09-11T14:16:01.497752+0000","last_became_peered":"2024-09-11T14:16:01.497752+0000","last_unstale":"2024-09-11T14:29:55.503865+0000","last_undegraded":"2024-09-11T14:29:55.503865+0000","last_fullsized":"2024-09-11T14:29:55.503865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503010+0000","last_change":"2024-09-11T14:16:01.548238+0000","last_active":"2024-09-11T14:29:55.503010+0000","last_peered":"2024-09-11T14:29:55.503010+0000","last_clean":"2024-09-11T14:29:55.503010+0000","last_became_active":"2024-09-11T14:16:01.540272+0000","last_became_peered":"2024-09-11T14:16:01.540272+0000","last_unstale":"2024-09-11T14:29:55.503010+0000","last_undegraded":"2024-09-11T14:29:55.503010+0000","last_fullsized":"2024-09-11T14:29:55.503010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491594+0000","last_change":"2024-09-11T14:16:01.530012+0000","last_active":"2024-09-11T14:29:55.491594+0000","last_peered":"2024-09-11T14:29:55.491594+0000","last_clean":"2024-09-11T14:29:55.491594+0000","last_became_active":"2024-09-11T14:16:01.516906+0000","last_became_peered":"2024-09-11T14:16:01.516906+0000","last_unstale":"2024-09-11T14:29:55.491594+0000","last_undegraded":"2024-09-11T14:29:55.491594+0000","last_fullsized":"2024-09-11T14:29:55.491594+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.501848+0000","last_change":"2024-09-11T14:16:01.535163+0000","last_active":"2024-09-11T14:29:55.501848+0000","last_peered":"2024-09-11T14:29:55.501848+0000","last_clean":"2024-09-11T14:29:55.501848+0000","last_became_active":"2024-09-11T14:16:01.524168+0000","last_became_peered":"2024-09-11T14:16:01.524168+0000","last_unstale":"2024-09-11T14:29:55.501848+0000","last_undegraded":"2024-09-11T14:29:55.501848+0000","last_fullsized":"2024-09-11T14:29:55.501848+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.520363+0000","last_change":"2024-09-11T14:16:01.525020+0000","last_active":"2024-09-11T14:29:55.520363+0000","last_peered":"2024-09-11T14:29:55.520363+0000","last_clean":"2024-09-11T14:29:55.520363+0000","last_became_active":"2024-09-11T14:16:01.519043+0000","last_became_peered":"2024-09-11T14:16:01.519043+0000","last_unstale":"2024-09-11T14:29:55.520363+0000","last_undegraded":"2024-09-11T14:29:55.520363+0000","last_fullsized":"2024-09-11T14:29:55.520363+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511420+0000","last_change":"2024-09-11T14:16:01.514997+0000","last_active":"2024-09-11T14:29:55.511420+0000","last_peered":"2024-09-11T14:29:55.511420+0000","last_clean":"2024-09-11T14:29:55.511420+0000","last_became_active":"2024-09-11T14:16:01.508423+0000","last_became_peered":"2024-09-11T14:16:01.508423+0000","last_unstale":"2024-09-11T14:29:55.511420+0000","last_undegraded":"2024-09-11T14:29:55.511420+0000","last_fullsized":"2024-09-11T14:29:55.511420+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523289+0000","last_change":"2024-09-11T14:16:01.528298+0000","last_active":"2024-09-11T14:29:55.523289+0000","last_peered":"2024-09-11T14:29:55.523289+0000","last_clean":"2024-09-11T14:29:55.523289+0000","last_became_active":"2024-09-11T14:16:01.505280+0000","last_became_peered":"2024-09-11T14:16:01.505280+0000","last_unstale":"2024-09-11T14:29:55.523289+0000","last_undegraded":"2024-09-11T14:29:55.523289+0000","last_fullsized":"2024-09-11T14:29:55.523289+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511025+0000","last_change":"2024-09-11T14:16:01.582504+0000","last_active":"2024-09-11T14:29:55.511025+0000","last_peered":"2024-09-11T14:29:55.511025+0000","last_clean":"2024-09-11T14:29:55.511025+0000","last_became_active":"2024-09-11T14:16:01.573403+0000","last_became_peered":"2024-09-11T14:16:01.573403+0000","last_unstale":"2024-09-11T14:29:55.511025+0000","last_undegraded":"2024-09-11T14:29:55.511025+0000","last_fullsized":"2024-09-11T14:29:55.511025+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.525031+0000","last_change":"2024-09-11T14:16:01.614988+0000","last_active":"2024-09-11T14:29:55.525031+0000","last_peered":"2024-09-11T14:29:55.525031+0000","last_clean":"2024-09-11T14:29:55.525031+0000","last_became_active":"2024-09-11T14:16:01.607437+0000","last_became_peered":"2024-09-11T14:16:01.607437+0000","last_unstale":"2024-09-11T14:29:55.525031+0000","last_undegraded":"2024-09-11T14:29:55.525031+0000","last_fullsized":"2024-09-11T14:29:55.525031+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.517913+0000","last_change":"2024-09-11T14:16:01.537504+0000","last_active":"2024-09-11T14:29:55.517913+0000","last_peered":"2024-09-11T14:29:55.517913+0000","last_clean":"2024-09-11T14:29:55.517913+0000","last_became_active":"2024-09-11T14:16:01.520713+0000","last_became_peered":"2024-09-11T14:16:01.520713+0000","last_unstale":"2024-09-11T14:29:55.517913+0000","last_undegraded":"2024-09-11T14:29:55.517913+0000","last_fullsized":"2024-09-11T14:29:55.517913+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.509228+0000","last_change":"2024-09-11T14:16:01.486527+0000","last_active":"2024-09-11T14:29:55.509228+0000","last_peered":"2024-09-11T14:29:55.509228+0000","last_clean":"2024-09-11T14:29:55.509228+0000","last_became_active":"2024-09-11T14:16:01.470273+0000","last_became_peered":"2024-09-11T14:16:01.470273+0000","last_unstale":"2024-09-11T14:29:55.509228+0000","last_undegraded":"2024-09-11T14:29:55.509228+0000","last_fullsized":"2024-09-11T14:29:55.509228+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1467,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515484+0000","last_change":"2024-09-11T14:16:01.518850+0000","last_active":"2024-09-11T14:29:55.515484+0000","last_peered":"2024-09-11T14:29:55.515484+0000","last_clean":"2024-09-11T14:29:55.515484+0000","last_became_active":"2024-09-11T14:16:01.504043+0000","last_became_peered":"2024-09-11T14:16:01.504043+0000","last_unstale":"2024-09-11T14:29:55.515484+0000","last_undegraded":"2024-09-11T14:29:55.515484+0000","last_fullsized":"2024-09-11T14:29:55.515484+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.502154+0000","last_change":"2024-09-11T14:16:01.490663+0000","last_active":"2024-09-11T14:29:55.502154+0000","last_peered":"2024-09-11T14:29:55.502154+0000","last_clean":"2024-09-11T14:29:55.502154+0000","last_became_active":"2024-09-11T14:16:01.479206+0000","last_became_peered":"2024-09-11T14:16:01.479206+0000","last_unstale":"2024-09-11T14:29:55.502154+0000","last_undegraded":"2024-09-11T14:29:55.502154+0000","last_fullsized":"2024-09-11T14:29:55.502154+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506288+0000","last_change":"2024-09-11T14:11:01.590400+0000","last_active":"2024-09-11T14:29:55.506288+0000","last_peered":"2024-09-11T14:29:55.506288+0000","last_clean":"2024-09-11T14:29:55.506288+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:29:55.506288+0000","last_undegraded":"2024-09-11T14:29:55.506288+0000","last_fullsized":"2024-09-11T14:29:55.506288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491586+0000","last_change":"2024-09-11T14:11:01.587732+0000","last_active":"2024-09-11T14:29:55.491586+0000","last_peered":"2024-09-11T14:29:55.491586+0000","last_clean":"2024-09-11T14:29:55.491586+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:29:55.491586+0000","last_undegraded":"2024-09-11T14:29:55.491586+0000","last_fullsized":"2024-09-11T14:29:55.491586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506562+0000","last_change":"2024-09-11T14:11:01.587844+0000","last_active":"2024-09-11T14:29:55.506562+0000","last_peered":"2024-09-11T14:29:55.506562+0000","last_clean":"2024-09-11T14:29:55.506562+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:29:55.506562+0000","last_undegraded":"2024-09-11T14:29:55.506562+0000","last_fullsized":"2024-09-11T14:29:55.506562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489183+0000","last_change":"2024-09-11T14:11:01.585502+0000","last_active":"2024-09-11T14:29:55.489183+0000","last_peered":"2024-09-11T14:29:55.489183+0000","last_clean":"2024-09-11T14:29:55.489183+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:29:55.489183+0000","last_undegraded":"2024-09-11T14:29:55.489183+0000","last_fullsized":"2024-09-11T14:29:55.489183+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":2132,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.516852+0000","last_change":"2024-09-11T14:11:01.588321+0000","last_active":"2024-09-11T14:29:55.516852+0000","last_peered":"2024-09-11T14:29:55.516852+0000","last_clean":"2024-09-11T14:29:55.516852+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:29:55.516852+0000","last_undegraded":"2024-09-11T14:29:55.516852+0000","last_fullsized":"2024-09-11T14:29:55.516852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497120+0000","last_change":"2024-09-11T14:11:01.587060+0000","last_active":"2024-09-11T14:29:55.497120+0000","last_peered":"2024-09-11T14:29:55.497120+0000","last_clean":"2024-09-11T14:29:55.497120+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:29:55.497120+0000","last_undegraded":"2024-09-11T14:29:55.497120+0000","last_fullsized":"2024-09-11T14:29:55.497120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.536047+0000","last_change":"2024-09-11T14:11:01.589239+0000","last_active":"2024-09-11T14:29:55.536047+0000","last_peered":"2024-09-11T14:29:55.536047+0000","last_clean":"2024-09-11T14:29:55.536047+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:29:55.536047+0000","last_undegraded":"2024-09-11T14:29:55.536047+0000","last_fullsized":"2024-09-11T14:29:55.536047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":2131,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506831+0000","last_change":"2024-09-11T14:11:01.590912+0000","last_active":"2024-09-11T14:29:55.506831+0000","last_peered":"2024-09-11T14:29:55.506831+0000","last_clean":"2024-09-11T14:29:55.506831+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:29:55.506831+0000","last_undegraded":"2024-09-11T14:29:55.506831+0000","last_fullsized":"2024-09-11T14:29:55.506831+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2199,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489882+0000","last_change":"2024-09-11T14:10:58.605266+0000","last_active":"2024-09-11T14:29:55.489882+0000","last_peered":"2024-09-11T14:29:55.489882+0000","last_clean":"2024-09-11T14:29:55.489882+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:29:55.489882+0000","last_undegraded":"2024-09-11T14:29:55.489882+0000","last_fullsized":"2024-09-11T14:29:55.489882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70724,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301116,"statfs":{"total":96636764160,"available":96564342784,"internally_reserved":0,"allocated":3710976,"data_stored":2103141,"data_compressed":106589,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66488,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305352,"statfs":{"total":96636764160,"available":96568680448,"internally_reserved":0,"allocated":3645440,"data_stored":1500020,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60904,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310936,"statfs":{"total":96636764160,"available":96574398464,"internally_reserved":0,"allocated":3629056,"data_stored":1487224,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61012,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310828,"statfs":{"total":96636764160,"available":96574287872,"internally_reserved":0,"allocated":3739648,"data_stored":2120340,"data_compressed":112477,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:29:58.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:29:58.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.226+0000 7f9069f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:58.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.231+0000 7f9069f91640 1 Processor -- start 2024-09-11T14:29:58.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.231+0000 7f9069f91640 1 -- start start 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f9069f91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9064132790 0x7f9064132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f9069f91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9064098840 con 0x7f906409b680 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f9069f91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f906409ac90 con 0x7f9064132790 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90637fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9064132790 0x7f9064132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90637fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9064132790 0x7f9064132ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56452/0 (socket says 172.21.15.97:56452) 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90637fe640 1 -- 172.21.15.97:0/3736144359 learned_addr learned my addr 172.21.15.97:0/3736144359 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f9062ffd640 1 --1- 172.21.15.97:0/3736144359 >> v1:172.21.15.97:6789/0 conn(0x7f906409b680 0x7f906409ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52422/0 (socket says 172.21.15.97:52422) 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90637fe640 1 -- 172.21.15.97:0/3736144359 >> v1:172.21.15.97:6789/0 conn(0x7f906409b680 legacy=0x7f906409ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:58.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90637fe640 1 -- 172.21.15.97:0/3736144359 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906409cb70 con 0x7f9064132790 2024-09-11T14:29:58.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90627fc640 1 -- 172.21.15.97:0/3736144359 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897259943 0 0) 0x7f9064098840 con 0x7f906409b680 2024-09-11T14:29:58.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90637fe640 1 --2- 172.21.15.97:0/3736144359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9064132790 0x7f9064132ba0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dddeffaf434663 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:58.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90627fc640 1 -- 172.21.15.97:0/3736144359 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9054010570 con 0x7f9064132790 2024-09-11T14:29:58.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90627fc640 1 -- 172.21.15.97:0/3736144359 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f90540106d0 con 0x7f9064132790 2024-09-11T14:29:58.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.232+0000 7f90627fc640 1 -- 172.21.15.97:0/3736144359 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9054010970 con 0x7f9064132790 2024-09-11T14:29:58.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.233+0000 7f9069f91640 1 -- 172.21.15.97:0/3736144359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9064132790 msgr2=0x7f9064132ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:58.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.233+0000 7f9069f91640 1 --2- 172.21.15.97:0/3736144359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9064132790 0x7f9064132ba0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.233+0000 7f9069f91640 1 -- 172.21.15.97:0/3736144359 shutdown_connections 2024-09-11T14:29:58.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.233+0000 7f9069f91640 1 --2- 172.21.15.97:0/3736144359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9064132790 0x7f9064132ba0 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.233+0000 7f9069f91640 1 -- 172.21.15.97:0/3736144359 >> 172.21.15.97:0/3736144359 conn(0x7f90640a11f0 msgr2=0x7f90640a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:58.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.233+0000 7f9069f91640 1 -- 172.21.15.97:0/3736144359 shutdown_connections 2024-09-11T14:29:58.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.233+0000 7f9069f91640 1 -- 172.21.15.97:0/3736144359 wait complete. 2024-09-11T14:29:58.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.234+0000 7f9069f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:58.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.235+0000 7f9069f91640 1 Processor -- start 2024-09-11T14:29:58.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.235+0000 7f9069f91640 1 -- start start 2024-09-11T14:29:58.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.236+0000 7f9069f91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f906409b680 0x7f906412fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:58.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.236+0000 7f9069f91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f906412c830 con 0x7f906409b680 2024-09-11T14:29:58.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.236+0000 7f90637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f906409b680 0x7f906412fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:58.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.236+0000 7f90637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f906409b680 0x7f906412fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56456/0 (socket says 172.21.15.97:56456) 2024-09-11T14:29:58.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.236+0000 7f90637fe640 1 -- 172.21.15.97:0/2275614838 learned_addr learned my addr 172.21.15.97:0/2275614838 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:58.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.236+0000 7f90637fe640 1 -- 172.21.15.97:0/2275614838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906412caf0 con 0x7f906409b680 2024-09-11T14:29:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.236+0000 7f90637fe640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f906409b680 0x7f906412fdc0 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.237+0000 7f904bfff640 1 -- 172.21.15.97:0/2275614838 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f905400f6a0 con 0x7f906409b680 2024-09-11T14:29:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.237+0000 7f904bfff640 1 -- 172.21.15.97:0/2275614838 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f905400f800 con 0x7f906409b680 2024-09-11T14:29:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.237+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906412b1b0 con 0x7f906409b680 2024-09-11T14:29:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.237+0000 7f904bfff640 1 -- 172.21.15.97:0/2275614838 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f905400faa0 con 0x7f906409b680 2024-09-11T14:29:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.237+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906412b7a0 con 0x7f906409b680 2024-09-11T14:29:58.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.238+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906409e480 con 0x7f906409b680 2024-09-11T14:29:58.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.238+0000 7f904bfff640 1 -- 172.21.15.97:0/2275614838 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f905400fc50 con 0x7f906409b680 2024-09-11T14:29:58.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.238+0000 7f904bfff640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f905003e930 0x7f9050040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:58.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.238+0000 7f904bfff640 1 -- 172.21.15.97:0/2275614838 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f9054053440 con 0x7f906409b680 2024-09-11T14:29:58.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.238+0000 7f9062ffd640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f905003e930 0x7f9050040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:58.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.239+0000 7f9062ffd640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f905003e930 0x7f9050040e40 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.243+0000 7f904bfff640 1 -- 172.21.15.97:0/2275614838 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f9054009430 con 0x7f906409b680 2024-09-11T14:29:58.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.419+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9064131980 con 0x7f906409b680 2024-09-11T14:29:58.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.420+0000 7f904bfff640 1 -- 172.21.15.97:0/2275614838 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v720) ==== 74+0+11279 (crc 0 0 0) 0x7f9054009250 con 0x7f906409b680 2024-09-11T14:29:58.421 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:29:58.421 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":720,"fsid":"f3855fa8-d59d-46b3-8802-359d51f9681f","created":"2024-09-11T14:10:48.224532+0000","modified":"2024-09-11T14:29:56.468542+0000","last_up_change":"2024-09-11T14:10:55.538592+0000","last_in_change":"2024-09-11T14:10:50.338674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:10:56.553117+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:10:58.455255+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-11T14:15:59.436161+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22e03614-3c25-4e5f-9dcc-6ea59cce138b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6801","nonce":2470268139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2470268139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6805","nonce":2470268139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2470268139}]},"public_addr":"172.21.15.97:6801/2470268139","cluster_addr":"172.21.15.97:6800/2470268139","heartbeat_back_addr":"172.21.15.97:6805/2470268139","heartbeat_front_addr":"172.21.15.97:6802/2470268139","state":["exists","up"]},{"osd":1,"uuid":"d2ff11a2-ef9b-4bd8-aaa9-73003208b30a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1629092190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6803","nonce":1629092190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6807","nonce":1629092190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1629092190}]},"public_addr":"172.21.15.97:6804/1629092190","cluster_addr":"172.21.15.97:6803/1629092190","heartbeat_back_addr":"172.21.15.97:6807/1629092190","heartbeat_front_addr":"172.21.15.97:6808/1629092190","state":["exists","up"]},{"osd":2,"uuid":"40d2d04e-30e4-45e0-bbb5-a159d1eb2779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":2173725438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2173725438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2173725438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":2173725438}]},"public_addr":"172.21.15.117:6811/2173725438","cluster_addr":"172.21.15.117:6810/2173725438","heartbeat_back_addr":"172.21.15.117:6806/2173725438","heartbeat_front_addr":"172.21.15.117:6803/2173725438","state":["exists","up"]},{"osd":3,"uuid":"b73e62e2-3d2b-4bf6-8961-2ea27b214707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":4196478755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":4196478755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":4196478755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":4196478755}]},"public_addr":"172.21.15.117:6808/4196478755","cluster_addr":"172.21.15.117:6807/4196478755","heartbeat_back_addr":"172.21.15.117:6805/4196478755","heartbeat_front_addr":"172.21.15.117:6804/4196478755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f905003e930 msgr2=0x7f9050040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f905003e930 0x7f9050040e40 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f906409b680 msgr2=0x7f906412fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f906409b680 0x7f906412fdc0 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 shutdown_connections 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f905003e930 0x7f9050040e40 unknown :-1 s=CLOSED pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 --2- 172.21.15.97:0/2275614838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f906409b680 0x7f906412fdc0 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 >> 172.21.15.97:0/2275614838 conn(0x7f90640a11f0 msgr2=0x7f90640a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 shutdown_connections 2024-09-11T14:29:58.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:58.422+0000 7f9069f91640 1 -- 172.21.15.97:0/2275614838 wait complete. 2024-09-11T14:29:59.436 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T14:29:59.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:29:59.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.544+0000 7fa746391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:59.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.553+0000 7fa746391640 1 Processor -- start 2024-09-11T14:29:59.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.553+0000 7fa746391640 1 -- start start 2024-09-11T14:29:59.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.554+0000 7fa746391640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa740138f20 0x7fa74013b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:59.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.554+0000 7fa746391640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa740132670 con 0x7fa7401328a0 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.554+0000 7fa746391640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa740069b80 con 0x7fa740138f20 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa740138f20 0x7fa74013b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa740138f20 0x7fa74013b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56468/0 (socket says 172.21.15.97:56468) 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa7401328a0 0x7fa740132cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52436/0 (socket says 172.21.15.97:52436) 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73f7fe640 1 -- 172.21.15.97:0/3078132118 learned_addr learned my addr 172.21.15.97:0/3078132118 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73effd640 1 -- 172.21.15.97:0/3078132118 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884243436 0 0) 0x7fa740132670 con 0x7fa7401328a0 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73f7fe640 1 -- 172.21.15.97:0/3078132118 >> v1:172.21.15.97:6789/0 conn(0x7fa7401328a0 legacy=0x7fa740132cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73f7fe640 1 -- 172.21.15.97:0/3078132118 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa740073690 con 0x7fa740138f20 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73f7fe640 1 --2- 172.21.15.97:0/3078132118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa740138f20 0x7fa74013b340 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6582fb36de6b319f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73effd640 1 -- 172.21.15.97:0/3078132118 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa734009e50 con 0x7fa740138f20 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73effd640 1 -- 172.21.15.97:0/3078132118 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa73400e230 con 0x7fa740138f20 2024-09-11T14:29:59.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.555+0000 7fa73effd640 1 -- 172.21.15.97:0/3078132118 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa73400e4d0 con 0x7fa740138f20 2024-09-11T14:29:59.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 1 -- 172.21.15.97:0/3078132118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa740138f20 msgr2=0x7fa74013b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 1 --2- 172.21.15.97:0/3078132118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa740138f20 0x7fa74013b340 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 1 -- 172.21.15.97:0/3078132118 shutdown_connections 2024-09-11T14:29:59.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 1 --2- 172.21.15.97:0/3078132118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa740138f20 0x7fa74013b340 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 1 -- 172.21.15.97:0/3078132118 >> 172.21.15.97:0/3078132118 conn(0x7fa7400a33b0 msgr2=0x7fa7400a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:59.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 1 -- 172.21.15.97:0/3078132118 shutdown_connections 2024-09-11T14:29:59.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 1 -- 172.21.15.97:0/3078132118 wait complete. 2024-09-11T14:29:59.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.556+0000 7fa746391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:59.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.558+0000 7fa746391640 1 Processor -- start 2024-09-11T14:29:59.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.558+0000 7fa746391640 1 -- start start 2024-09-11T14:29:59.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa746391640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7401328a0 0x7fa7401ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:59.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa746391640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa7400a14d0 con 0x7fa7401328a0 2024-09-11T14:29:59.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7401328a0 0x7fa7401ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:59.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa73ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7401328a0 0x7fa7401ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56474/0 (socket says 172.21.15.97:56474) 2024-09-11T14:29:59.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa73ffff640 1 -- 172.21.15.97:0/481501944 learned_addr learned my addr 172.21.15.97:0/481501944 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:59.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa73ffff640 1 -- 172.21.15.97:0/481501944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74011f1b0 con 0x7fa7401328a0 2024-09-11T14:29:59.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa73ffff640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7401328a0 0x7fa7401ca690 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:59.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.559+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa730004b80 con 0x7fa7401328a0 2024-09-11T14:29:59.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.560+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa730004ce0 con 0x7fa7401328a0 2024-09-11T14:29:59.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.560+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74009fcd0 con 0x7fa7401328a0 2024-09-11T14:29:59.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.560+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa730007120 con 0x7fa7401328a0 2024-09-11T14:29:59.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.560+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa740120650 con 0x7fa7401328a0 2024-09-11T14:29:59.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.560+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7400a4130 con 0x7fa7401328a0 2024-09-11T14:29:59.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.560+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa7300072d0 con 0x7fa7401328a0 2024-09-11T14:29:59.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.561+0000 7fa73cff9640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa72c03e930 0x7fa72c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:59.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.561+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7fa73004fab0 con 0x7fa7401328a0 2024-09-11T14:29:59.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.561+0000 7fa73cff9640 1 --2- 172.21.15.97:0/481501944 >> v2:172.21.15.97:6801/2470268139 conn(0x7fa72c044a70 0x7fa72c046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:59.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.561+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 --> v2:172.21.15.97:6801/2470268139 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa72c0475f0 con 0x7fa72c044a70 2024-09-11T14:29:59.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.561+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7fa73004fe40 con 0x7fa7401328a0 2024-09-11T14:29:59.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.561+0000 7fa73f7fe640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa72c03e930 0x7fa72c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:59.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.562+0000 7fa73f7fe640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa72c03e930 0x7fa72c040e40 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:59.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.562+0000 7fa74492e640 1 --2- 172.21.15.97:0/481501944 >> v2:172.21.15.97:6801/2470268139 conn(0x7fa72c044a70 0x7fa72c046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:29:59.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.565+0000 7fa74492e640 1 --2- 172.21.15.97:0/481501944 >> v2:172.21.15.97:6801/2470268139 conn(0x7fa72c044a70 0x7fa72c046f60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:59.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.567+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== osd.0 v2:172.21.15.97:6801/2470268139 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fa72c0475f0 con 0x7fa72c044a70 2024-09-11T14:29:59.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.570+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 --> v2:172.21.15.97:6801/2470268139 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa740120aa0 con 0x7fa72c044a70 2024-09-11T14:29:59.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.572+0000 7fa73cff9640 1 -- 172.21.15.97:0/481501944 <== osd.0 v2:172.21.15.97:6801/2470268139 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fa740120aa0 con 0x7fa72c044a70 2024-09-11T14:29:59.573 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-11T14:29:59.573 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "" 2024-09-11T14:29:59.573 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-11T14:29:59.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.572+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 >> v2:172.21.15.97:6801/2470268139 conn(0x7fa72c044a70 msgr2=0x7fa72c046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.572+0000 7fa746391640 1 --2- 172.21.15.97:0/481501944 >> v2:172.21.15.97:6801/2470268139 conn(0x7fa72c044a70 0x7fa72c046f60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa72c03e930 msgr2=0x7fa72c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa72c03e930 0x7fa72c040e40 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7401328a0 msgr2=0x7fa7401ca690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7401328a0 0x7fa7401ca690 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 shutdown_connections 2024-09-11T14:29:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 --2- 172.21.15.97:0/481501944 >> v2:172.21.15.97:6801/2470268139 conn(0x7fa72c044a70 0x7fa72c046f60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa72c03e930 0x7fa72c040e40 unknown :-1 s=CLOSED pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 --2- 172.21.15.97:0/481501944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7401328a0 0x7fa7401ca690 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 >> 172.21.15.97:0/481501944 conn(0x7fa7400a33b0 msgr2=0x7fa74006f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 shutdown_connections 2024-09-11T14:29:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.574+0000 7fa746391640 1 -- 172.21.15.97:0/481501944 wait complete. 2024-09-11T14:29:59.585 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T14:29:59.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.689+0000 7fcf11f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:59.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.695+0000 7fcf11f91640 1 Processor -- start 2024-09-11T14:29:59.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.695+0000 7fcf11f91640 1 -- start start 2024-09-11T14:29:59.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.696+0000 7fcf11f91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcf0c135570 0x7fcf0c137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:59.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.696+0000 7fcf11f91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf0c098840 con 0x7fcf0c132790 2024-09-11T14:29:59.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.696+0000 7fcf11f91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fcf0c09ac90 con 0x7fcf0c135570 2024-09-11T14:29:59.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.696+0000 7fcf0affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcf0c135570 0x7fcf0c137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.696+0000 7fcf0affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcf0c135570 0x7fcf0c137990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56486/0 (socket says 172.21.15.97:56486) 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.696+0000 7fcf0b7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcf0c132790 0x7fcf0c132ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52444/0 (socket says 172.21.15.97:52444) 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.696+0000 7fcf0affd640 1 -- 172.21.15.97:0/2380330314 learned_addr learned my addr 172.21.15.97:0/2380330314 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.697+0000 7fcf0affd640 1 -- 172.21.15.97:0/2380330314 >> v1:172.21.15.97:6789/0 conn(0x7fcf0c132790 legacy=0x7fcf0c132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.697+0000 7fcf0affd640 1 -- 172.21.15.97:0/2380330314 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0c09cb70 con 0x7fcf0c135570 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.697+0000 7fcf0affd640 1 --2- 172.21.15.97:0/2380330314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c135570 0x7fcf0c137990 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764ebd2f7d93bfd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.697+0000 7fcf0a7fc640 1 -- 172.21.15.97:0/2380330314 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf0000d580 con 0x7fcf0c135570 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.697+0000 7fcf0a7fc640 1 -- 172.21.15.97:0/2380330314 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcf0000d6e0 con 0x7fcf0c135570 2024-09-11T14:29:59.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.697+0000 7fcf0a7fc640 1 -- 172.21.15.97:0/2380330314 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf0000d980 con 0x7fcf0c135570 2024-09-11T14:29:59.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 1 -- 172.21.15.97:0/2380330314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c135570 msgr2=0x7fcf0c137990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 1 --2- 172.21.15.97:0/2380330314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c135570 0x7fcf0c137990 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 1 -- 172.21.15.97:0/2380330314 shutdown_connections 2024-09-11T14:29:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 1 --2- 172.21.15.97:0/2380330314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c135570 0x7fcf0c137990 unknown :-1 s=CLOSED pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 1 -- 172.21.15.97:0/2380330314 >> 172.21.15.97:0/2380330314 conn(0x7fcf0c0a11f0 msgr2=0x7fcf0c0a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 1 -- 172.21.15.97:0/2380330314 shutdown_connections 2024-09-11T14:29:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 1 -- 172.21.15.97:0/2380330314 wait complete. 2024-09-11T14:29:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.698+0000 7fcf11f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:29:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.699+0000 7fcf11f91640 1 Processor -- start 2024-09-11T14:29:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.699+0000 7fcf11f91640 1 -- start start 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.700+0000 7fcf11f91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c132790 0x7fcf0c072f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.700+0000 7fcf11f91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c12ff40 con 0x7fcf0c132790 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcf0b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c132790 0x7fcf0c072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcf0b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c132790 0x7fcf0c072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56500/0 (socket says 172.21.15.97:56500) 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcf0b7fe640 1 -- 172.21.15.97:0/1183987966 learned_addr learned my addr 172.21.15.97:0/1183987966 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcf0b7fe640 1 -- 172.21.15.97:0/1183987966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0c074940 con 0x7fcf0c132790 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcf0b7fe640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c132790 0x7fcf0c072f00 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcef3fff640 1 -- 172.21.15.97:0/1183987966 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcefc0071e0 con 0x7fcf0c132790 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcef3fff640 1 -- 172.21.15.97:0/1183987966 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcefc007340 con 0x7fcf0c132790 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0c134680 con 0x7fcf0c132790 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcef3fff640 1 -- 172.21.15.97:0/1183987966 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcefc0075e0 con 0x7fcf0c132790 2024-09-11T14:29:59.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.701+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf0c12d650 con 0x7fcf0c132790 2024-09-11T14:29:59.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.702+0000 7fcef3fff640 1 -- 172.21.15.97:0/1183987966 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcefc007790 con 0x7fcf0c132790 2024-09-11T14:29:59.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.702+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf0c12ddd0 con 0x7fcf0c132790 2024-09-11T14:29:59.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.702+0000 7fcef3fff640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fcef803e930 0x7fcef8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:29:59.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.702+0000 7fcef3fff640 1 -- 172.21.15.97:0/1183987966 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7fcefc0504d0 con 0x7fcf0c132790 2024-09-11T14:29:59.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.703+0000 7fcf0affd640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fcef803e930 0x7fcef8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:29:59.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.703+0000 7fcf0affd640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fcef803e930 0x7fcef8040e40 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:29:59.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.708+0000 7fcef3fff640 1 -- 172.21.15.97:0/1183987966 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fcefc009bc0 con 0x7fcf0c132790 2024-09-11T14:29:59.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.883+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fcf0c1344f0 con 0x7fcef803e930 2024-09-11T14:29:59.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.884+0000 7fcef3fff640 1 -- 172.21.15.97:0/1183987966 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fcf0c1344f0 con 0x7fcef803e930 2024-09-11T14:29:59.885 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T14:29:59.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.887+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fcef803e930 msgr2=0x7fcef8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.887+0000 7fcf11f91640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fcef803e930 0x7fcef8040e40 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.887+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c132790 msgr2=0x7fcf0c072f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:29:59.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.887+0000 7fcf11f91640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c132790 0x7fcf0c072f00 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.887+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 shutdown_connections 2024-09-11T14:29:59.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.888+0000 7fcf11f91640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fcef803e930 0x7fcef8040e40 unknown :-1 s=CLOSED pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.888+0000 7fcf11f91640 1 --2- 172.21.15.97:0/1183987966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf0c132790 0x7fcf0c072f00 unknown :-1 s=CLOSED pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:29:59.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.888+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 >> 172.21.15.97:0/1183987966 conn(0x7fcf0c0a11f0 msgr2=0x7fcf0c131720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:29:59.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.888+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 shutdown_connections 2024-09-11T14:29:59.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:29:59.888+0000 7fcf11f91640 1 -- 172.21.15.97:0/1183987966 wait complete. 2024-09-11T14:29:59.911 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T14:29:59.912 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:30:00.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.014+0000 7f5773b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.023+0000 7f5773b08640 1 Processor -- start 2024-09-11T14:30:00.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.024+0000 7f5773b08640 1 -- start start 2024-09-11T14:30:00.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f5773b08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f576c072f90 0x7f576c139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f5773b08640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f576c073690 con 0x7f576c072470 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f5773b08640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f576c0738c0 con 0x7f576c072f90 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57710a3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f576c072f90 0x7f576c139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57710a3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f576c072f90 0x7f576c139030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56504/0 (socket says 172.21.15.97:56504) 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57718a4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f576c072470 0x7f576c072880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52456/0 (socket says 172.21.15.97:52456) 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57710a3640 1 -- 172.21.15.97:0/1460862347 learned_addr learned my addr 172.21.15.97:0/1460862347 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57710a3640 1 -- 172.21.15.97:0/1460862347 >> v1:172.21.15.97:6789/0 conn(0x7f576c072470 legacy=0x7f576c072880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57710a3640 1 -- 172.21.15.97:0/1460862347 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c069fb0 con 0x7f576c072f90 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57708a2640 1 -- 172.21.15.97:0/1460862347 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965333086 0 0) 0x7f576c073690 con 0x7f576c072470 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57710a3640 1 --2- 172.21.15.97:0/1460862347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072f90 0x7f576c139030 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cfadc62bf608a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57708a2640 1 -- 172.21.15.97:0/1460862347 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f575c009e50 con 0x7f576c072f90 2024-09-11T14:30:00.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57708a2640 1 -- 172.21.15.97:0/1460862347 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f575c00e230 con 0x7f576c072f90 2024-09-11T14:30:00.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.025+0000 7f57708a2640 1 -- 172.21.15.97:0/1460862347 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f575c00e4d0 con 0x7f576c072f90 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 1 -- 172.21.15.97:0/1460862347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072f90 msgr2=0x7f576c139030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 1 --2- 172.21.15.97:0/1460862347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072f90 0x7f576c139030 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 1 -- 172.21.15.97:0/1460862347 shutdown_connections 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 1 --2- 172.21.15.97:0/1460862347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072f90 0x7f576c139030 unknown :-1 s=CLOSED pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 1 -- 172.21.15.97:0/1460862347 >> 172.21.15.97:0/1460862347 conn(0x7f576c0a33b0 msgr2=0x7f576c0a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 1 -- 172.21.15.97:0/1460862347 shutdown_connections 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 1 -- 172.21.15.97:0/1460862347 wait complete. 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.026+0000 7f5773b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.028+0000 7f5773b08640 1 Processor -- start 2024-09-11T14:30:00.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.028+0000 7f5773b08640 1 -- start start 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f5773b08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072470 0x7f576c122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f5773b08640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f576c125a50 con 0x7f576c072470 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57718a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072470 0x7f576c122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57718a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072470 0x7f576c122440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56508/0 (socket says 172.21.15.97:56508) 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57718a4640 1 -- 172.21.15.97:0/2358560205 learned_addr learned my addr 172.21.15.97:0/2358560205 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57718a4640 1 -- 172.21.15.97:0/2358560205 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c121f80 con 0x7f576c072470 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57718a4640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072470 0x7f576c122440 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5768004b80 con 0x7f576c072470 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5768004ce0 con 0x7f576c072470 2024-09-11T14:30:00.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576c123460 con 0x7f576c072470 2024-09-11T14:30:00.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5768007120 con 0x7f576c072470 2024-09-11T14:30:00.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.029+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576c123d10 con 0x7f576c072470 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.030+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f57680072d0 con 0x7f576c072470 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.030+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f576c121e10 con 0x7f576c072470 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.031+0000 7f57627fc640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f575003e930 0x7f5750040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.031+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f576804fac0 con 0x7f576c072470 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.031+0000 7f57627fc640 1 --2- 172.21.15.97:0/2358560205 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5750044a70 0x7f5750046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.031+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 --> v2:172.21.15.97:6804/1629092190 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57500475f0 con 0x7f5750044a70 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.031+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7f576804fe50 con 0x7f576c072470 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.031+0000 7f57710a3640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f575003e930 0x7f5750040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.032+0000 7f57720a5640 1 --2- 172.21.15.97:0/2358560205 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5750044a70 0x7f5750046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:30:00.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.032+0000 7f57710a3640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f575003e930 0x7f5750040e40 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.035+0000 7f57720a5640 1 --2- 172.21.15.97:0/2358560205 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5750044a70 0x7f5750046f60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.037+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== osd.1 v2:172.21.15.97:6804/1629092190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f57500475f0 con 0x7f5750044a70 2024-09-11T14:30:00.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.040+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 --> v2:172.21.15.97:6804/1629092190 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f576c0743c0 con 0x7f5750044a70 2024-09-11T14:30:00.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f57627fc640 1 -- 172.21.15.97:0/2358560205 <== osd.1 v2:172.21.15.97:6804/1629092190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f576400a820 con 0x7f5750044a70 2024-09-11T14:30:00.043 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-11T14:30:00.043 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "" 2024-09-11T14:30:00.043 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-11T14:30:00.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5750044a70 msgr2=0x7f5750046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 --2- 172.21.15.97:0/2358560205 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5750044a70 0x7f5750046f60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f575003e930 msgr2=0x7f5750040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f575003e930 0x7f5750040e40 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072470 msgr2=0x7f576c122440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072470 0x7f576c122440 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 shutdown_connections 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 --2- 172.21.15.97:0/2358560205 >> v2:172.21.15.97:6804/1629092190 conn(0x7f5750044a70 0x7f5750046f60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f575003e930 0x7f5750040e40 unknown :-1 s=CLOSED pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 --2- 172.21.15.97:0/2358560205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f576c072470 0x7f576c122440 unknown :-1 s=CLOSED pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 >> 172.21.15.97:0/2358560205 conn(0x7f576c0a33b0 msgr2=0x7f576c11ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 shutdown_connections 2024-09-11T14:30:00.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.042+0000 7f5773b08640 1 -- 172.21.15.97:0/2358560205 wait complete. 2024-09-11T14:30:00.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T14:30:00.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.160+0000 7fd5b9293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.166+0000 7fd5b9293640 1 Processor -- start 2024-09-11T14:30:00.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.166+0000 7fd5b9293640 1 -- start start 2024-09-11T14:30:00.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.167+0000 7fd5b9293640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5b41360f0 0x7fd5b4136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.167+0000 7fd5b9293640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b40a5c40 con 0x7fd5b409e170 2024-09-11T14:30:00.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.167+0000 7fd5b9293640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b40a6010 con 0x7fd5b41360f0 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.167+0000 7fd5b2ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5b41360f0 0x7fd5b4136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.167+0000 7fd5b2ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5b41360f0 0x7fd5b4136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56512/0 (socket says 172.21.15.97:56512) 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.167+0000 7fd5b2ffd640 1 -- 172.21.15.97:0/1536356721 learned_addr learned my addr 172.21.15.97:0/1536356721 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.167+0000 7fd5aa7fc640 1 --1- 172.21.15.97:0/1536356721 >> v1:172.21.15.97:6789/0 conn(0x7fd5b409e170 0x7fd5b409e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52466/0 (socket says 172.21.15.97:52466) 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.168+0000 7fd5b2ffd640 1 -- 172.21.15.97:0/1536356721 >> v1:172.21.15.97:6789/0 conn(0x7fd5b409e170 legacy=0x7fd5b409e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.168+0000 7fd5b2ffd640 1 -- 172.21.15.97:0/1536356721 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b409f510 con 0x7fd5b41360f0 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.168+0000 7fd5b27fc640 1 -- 172.21.15.97:0/1536356721 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438208450 0 0) 0x7fd5b40a5c40 con 0x7fd5b409e170 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.168+0000 7fd5b2ffd640 1 --2- 172.21.15.97:0/1536356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b41360f0 0x7fd5b4136500 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f851ab37926227 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.168+0000 7fd5b27fc640 1 -- 172.21.15.97:0/1536356721 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5a4009e50 con 0x7fd5b41360f0 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.168+0000 7fd5b27fc640 1 -- 172.21.15.97:0/1536356721 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd5a400e230 con 0x7fd5b41360f0 2024-09-11T14:30:00.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.168+0000 7fd5b27fc640 1 -- 172.21.15.97:0/1536356721 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5a400e4d0 con 0x7fd5b41360f0 2024-09-11T14:30:00.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 1 -- 172.21.15.97:0/1536356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b41360f0 msgr2=0x7fd5b4136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 1 --2- 172.21.15.97:0/1536356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b41360f0 0x7fd5b4136500 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 1 -- 172.21.15.97:0/1536356721 shutdown_connections 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 1 --2- 172.21.15.97:0/1536356721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b41360f0 0x7fd5b4136500 unknown :-1 s=CLOSED pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 1 -- 172.21.15.97:0/1536356721 >> 172.21.15.97:0/1536356721 conn(0x7fd5b406f850 msgr2=0x7fd5b409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 1 -- 172.21.15.97:0/1536356721 shutdown_connections 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 1 -- 172.21.15.97:0/1536356721 wait complete. 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.169+0000 7fd5b9293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.170+0000 7fd5b9293640 1 Processor -- start 2024-09-11T14:30:00.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.171+0000 7fd5b9293640 1 -- start start 2024-09-11T14:30:00.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b9293640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b409e170 0x7fd5b4120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b9293640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4124ba0 con 0x7fd5b409e170 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b409e170 0x7fd5b4120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b409e170 0x7fd5b4120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56522/0 (socket says 172.21.15.97:56522) 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b2ffd640 1 -- 172.21.15.97:0/3482480928 learned_addr learned my addr 172.21.15.97:0/3482480928 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b2ffd640 1 -- 172.21.15.97:0/3482480928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b4124810 con 0x7fd5b409e170 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b2ffd640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b409e170 0x7fd5b4120b70 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5abfff640 1 -- 172.21.15.97:0/3482480928 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5a400ede0 con 0x7fd5b409e170 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5abfff640 1 -- 172.21.15.97:0/3482480928 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd5a4015420 con 0x7fd5b409e170 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b4121ff0 con 0x7fd5b409e170 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5abfff640 1 -- 172.21.15.97:0/3482480928 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5a40156c0 con 0x7fd5b409e170 2024-09-11T14:30:00.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.172+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b4124500 con 0x7fd5b409e170 2024-09-11T14:30:00.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.173+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b40008d0 con 0x7fd5b409e170 2024-09-11T14:30:00.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.173+0000 7fd5abfff640 1 -- 172.21.15.97:0/3482480928 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd5a4015870 con 0x7fd5b409e170 2024-09-11T14:30:00.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.174+0000 7fd5abfff640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd59403e930 0x7fd594040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.174+0000 7fd5abfff640 1 -- 172.21.15.97:0/3482480928 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7fd5a4050ed0 con 0x7fd5b409e170 2024-09-11T14:30:00.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.174+0000 7fd5aa7fc640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd59403e930 0x7fd594040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.175+0000 7fd5aa7fc640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd59403e930 0x7fd594040e40 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.179+0000 7fd5abfff640 1 -- 172.21.15.97:0/3482480928 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd5a4010a00 con 0x7fd5b409e170 2024-09-11T14:30:00.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.352+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd5b406fec0 con 0x7fd59403e930 2024-09-11T14:30:00.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.353+0000 7fd5abfff640 1 -- 172.21.15.97:0/3482480928 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fd59c0070b0 con 0x7fd59403e930 2024-09-11T14:30:00.354 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd59403e930 msgr2=0x7fd594040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd59403e930 0x7fd594040e40 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b409e170 msgr2=0x7fd5b4120b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b409e170 0x7fd5b4120b70 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 shutdown_connections 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fd59403e930 0x7fd594040e40 unknown :-1 s=CLOSED pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 --2- 172.21.15.97:0/3482480928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5b409e170 0x7fd5b4120b70 unknown :-1 s=CLOSED pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 >> 172.21.15.97:0/3482480928 conn(0x7fd5b406f850 msgr2=0x7fd5b41bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 shutdown_connections 2024-09-11T14:30:00.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.355+0000 7fd5b9293640 1 -- 172.21.15.97:0/3482480928 wait complete. 2024-09-11T14:30:00.373 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T14:30:00.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:30:00.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.481+0000 7ffbd3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.490+0000 7ffbd3d11640 1 Processor -- start 2024-09-11T14:30:00.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.490+0000 7ffbd3d11640 1 -- start start 2024-09-11T14:30:00.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd3d11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffbcc09e330 0x7ffbcc1390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd3d11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbcc09eda0 con 0x7ffbcc09d810 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd3d11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc0a29e0 con 0x7ffbcc09e330 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd1aad640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffbcc09d810 0x7ffbcc09dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52478/0 (socket says 172.21.15.97:52478) 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd1aad640 1 -- 172.21.15.97:0/605564555 learned_addr learned my addr 172.21.15.97:0/605564555 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd12ac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffbcc09e330 0x7ffbcc1390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd12ac640 1 -- 172.21.15.97:0/605564555 >> v1:172.21.15.97:6789/0 conn(0x7ffbcc09d810 legacy=0x7ffbcc09dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd12ac640 1 -- 172.21.15.97:0/605564555 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc0a27b0 con 0x7ffbcc09e330 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd12ac640 1 --2- 172.21.15.97:0/605564555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09e330 0x7ffbcc1390e0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84078e5a0842335 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd0aab640 1 -- 172.21.15.97:0/605564555 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbbc009d90 con 0x7ffbcc09e330 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd0aab640 1 -- 172.21.15.97:0/605564555 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffbbc00e230 con 0x7ffbcc09e330 2024-09-11T14:30:00.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.492+0000 7ffbd0aab640 1 -- 172.21.15.97:0/605564555 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbbc00e4d0 con 0x7ffbcc09e330 2024-09-11T14:30:00.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 1 -- 172.21.15.97:0/605564555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09e330 msgr2=0x7ffbcc1390e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/605564555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09e330 0x7ffbcc1390e0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 1 -- 172.21.15.97:0/605564555 shutdown_connections 2024-09-11T14:30:00.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/605564555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09e330 0x7ffbcc1390e0 unknown :-1 s=CLOSED pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 1 -- 172.21.15.97:0/605564555 >> 172.21.15.97:0/605564555 conn(0x7ffbcc0a31b0 msgr2=0x7ffbcc0a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 1 -- 172.21.15.97:0/605564555 shutdown_connections 2024-09-11T14:30:00.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 1 -- 172.21.15.97:0/605564555 wait complete. 2024-09-11T14:30:00.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.493+0000 7ffbd3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.495+0000 7ffbd3d11640 1 Processor -- start 2024-09-11T14:30:00.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.495+0000 7ffbd3d11640 1 -- start start 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd3d11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09d810 0x7ffbcc1226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd3d11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc126450 con 0x7ffbcc09d810 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd1aad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09d810 0x7ffbcc1226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd1aad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09d810 0x7ffbcc1226f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56544/0 (socket says 172.21.15.97:56544) 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd1aad640 1 -- 172.21.15.97:0/240931377 learned_addr learned my addr 172.21.15.97:0/240931377 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd1aad640 1 -- 172.21.15.97:0/240931377 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc133420 con 0x7ffbcc09d810 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd1aad640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09d810 0x7ffbcc1226f0 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbc8005a60 con 0x7ffbcc09d810 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffbc8005bc0 con 0x7ffbcc09d810 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc1239a0 con 0x7ffbcc09d810 2024-09-11T14:30:00.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbc8005e60 con 0x7ffbcc09d810 2024-09-11T14:30:00.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.496+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc125070 con 0x7ffbcc09d810 2024-09-11T14:30:00.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.497+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffbcc050fc0 con 0x7ffbcc09d810 2024-09-11T14:30:00.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.497+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ffbc800c7f0 con 0x7ffbcc09d810 2024-09-11T14:30:00.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.498+0000 7ffbc27fc640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ffbb003e930 0x7ffbb0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.498+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7ffbc804f980 con 0x7ffbcc09d810 2024-09-11T14:30:00.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.498+0000 7ffbc27fc640 1 --2- 172.21.15.97:0/240931377 >> v2:172.21.15.117:6811/2173725438 conn(0x7ffbb0044a70 0x7ffbb0046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.498+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 --> v2:172.21.15.117:6811/2173725438 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbb00475f0 con 0x7ffbb0044a70 2024-09-11T14:30:00.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.498+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7ffbc804fd90 con 0x7ffbcc09d810 2024-09-11T14:30:00.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.498+0000 7ffbd12ac640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ffbb003e930 0x7ffbb0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.499+0000 7ffbd12ac640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ffbb003e930 0x7ffbb0040e40 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.499+0000 7ffbd22ae640 1 --2- 172.21.15.97:0/240931377 >> v2:172.21.15.117:6811/2173725438 conn(0x7ffbb0044a70 0x7ffbb0046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:30:00.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.503+0000 7ffbd22ae640 1 --2- 172.21.15.97:0/240931377 >> v2:172.21.15.117:6811/2173725438 conn(0x7ffbb0044a70 0x7ffbb0046f60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.505+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== osd.2 v2:172.21.15.117:6811/2173725438 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7ffbb00475f0 con 0x7ffbb0044a70 2024-09-11T14:30:00.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.508+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 --> v2:172.21.15.117:6811/2173725438 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffbcc09f750 con 0x7ffbb0044a70 2024-09-11T14:30:00.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbc27fc640 1 -- 172.21.15.97:0/240931377 <== osd.2 v2:172.21.15.117:6811/2173725438 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7ffbc400a820 con 0x7ffbb0044a70 2024-09-11T14:30:00.512 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-11T14:30:00.512 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "" 2024-09-11T14:30:00.512 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-11T14:30:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 >> v2:172.21.15.117:6811/2173725438 conn(0x7ffbb0044a70 msgr2=0x7ffbb0046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/240931377 >> v2:172.21.15.117:6811/2173725438 conn(0x7ffbb0044a70 0x7ffbb0046f60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ffbb003e930 msgr2=0x7ffbb0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ffbb003e930 0x7ffbb0040e40 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09d810 msgr2=0x7ffbcc1226f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09d810 0x7ffbcc1226f0 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 shutdown_connections 2024-09-11T14:30:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/240931377 >> v2:172.21.15.117:6811/2173725438 conn(0x7ffbb0044a70 0x7ffbb0046f60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7ffbb003e930 0x7ffbb0040e40 unknown :-1 s=CLOSED pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 --2- 172.21.15.97:0/240931377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffbcc09d810 0x7ffbcc1226f0 unknown :-1 s=CLOSED pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 >> 172.21.15.97:0/240931377 conn(0x7ffbcc0a31b0 msgr2=0x7ffbcc0a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 shutdown_connections 2024-09-11T14:30:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.511+0000 7ffbd3d11640 1 -- 172.21.15.97:0/240931377 wait complete. 2024-09-11T14:30:00.523 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T14:30:00.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.627+0000 7fab7ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.633+0000 7fab7ef91640 1 Processor -- start 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.633+0000 7fab7ef91640 1 -- start start 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7ef91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab781360f0 0x7fab78136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7ef91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab780a5c40 con 0x7fab7809e170 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7ef91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fab780a6010 con 0x7fab781360f0 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7cd2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab781360f0 0x7fab78136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7cd2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab781360f0 0x7fab78136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56552/0 (socket says 172.21.15.97:56552) 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab77fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fab7809e170 0x7fab7809e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52492/0 (socket says 172.21.15.97:52492) 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7cd2d640 1 -- 172.21.15.97:0/3989465534 learned_addr learned my addr 172.21.15.97:0/3989465534 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7cd2d640 1 -- 172.21.15.97:0/3989465534 >> v1:172.21.15.97:6789/0 conn(0x7fab7809e170 legacy=0x7fab7809e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7cd2d640 1 -- 172.21.15.97:0/3989465534 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7809f510 con 0x7fab781360f0 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab777fe640 1 -- 172.21.15.97:0/3989465534 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552884315 0 0) 0x7fab780a5c40 con 0x7fab7809e170 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.634+0000 7fab7cd2d640 1 --2- 172.21.15.97:0/3989465534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab781360f0 0x7fab78136500 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ca2f1c3a8fa53d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab777fe640 1 -- 172.21.15.97:0/3989465534 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab6800e040 con 0x7fab781360f0 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab777fe640 1 -- 172.21.15.97:0/3989465534 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab680091e0 con 0x7fab781360f0 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab777fe640 1 -- 172.21.15.97:0/3989465534 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab68007730 con 0x7fab781360f0 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab7ef91640 1 -- 172.21.15.97:0/3989465534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab781360f0 msgr2=0x7fab78136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab7ef91640 1 --2- 172.21.15.97:0/3989465534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab781360f0 0x7fab78136500 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab7ef91640 1 -- 172.21.15.97:0/3989465534 shutdown_connections 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab7ef91640 1 --2- 172.21.15.97:0/3989465534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab781360f0 0x7fab78136500 unknown :-1 s=CLOSED pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab7ef91640 1 -- 172.21.15.97:0/3989465534 >> 172.21.15.97:0/3989465534 conn(0x7fab7806f850 msgr2=0x7fab7809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab7ef91640 1 -- 172.21.15.97:0/3989465534 shutdown_connections 2024-09-11T14:30:00.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.635+0000 7fab7ef91640 1 -- 172.21.15.97:0/3989465534 wait complete. 2024-09-11T14:30:00.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.636+0000 7fab7ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.637+0000 7fab7ef91640 1 Processor -- start 2024-09-11T14:30:00.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.637+0000 7fab7ef91640 1 -- start start 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.638+0000 7fab7ef91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab7809e170 0x7fab78120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.638+0000 7fab7ef91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fab78124ba0 con 0x7fab7809e170 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.638+0000 7fab7cd2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab7809e170 0x7fab78120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.638+0000 7fab7cd2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab7809e170 0x7fab78120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56554/0 (socket says 172.21.15.97:56554) 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.638+0000 7fab7cd2d640 1 -- 172.21.15.97:0/4160179028 learned_addr learned my addr 172.21.15.97:0/4160179028 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.639+0000 7fab7cd2d640 1 -- 172.21.15.97:0/4160179028 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab78124810 con 0x7fab7809e170 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.639+0000 7fab7cd2d640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab7809e170 0x7fab78120b70 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.639+0000 7fab757fa640 1 -- 172.21.15.97:0/4160179028 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab6800e040 con 0x7fab7809e170 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.639+0000 7fab757fa640 1 -- 172.21.15.97:0/4160179028 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab680127c0 con 0x7fab7809e170 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.639+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab78121ff0 con 0x7fab7809e170 2024-09-11T14:30:00.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.639+0000 7fab757fa640 1 -- 172.21.15.97:0/4160179028 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab68012a60 con 0x7fab7809e170 2024-09-11T14:30:00.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.639+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab78124500 con 0x7fab7809e170 2024-09-11T14:30:00.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.640+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab780008d0 con 0x7fab7809e170 2024-09-11T14:30:00.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.640+0000 7fab757fa640 1 -- 172.21.15.97:0/4160179028 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fab68012bc0 con 0x7fab7809e170 2024-09-11T14:30:00.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.640+0000 7fab757fa640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab5803e930 0x7fab58040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.640+0000 7fab757fa640 1 -- 172.21.15.97:0/4160179028 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7fab68050eb0 con 0x7fab7809e170 2024-09-11T14:30:00.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.641+0000 7fab77fff640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab5803e930 0x7fab58040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.641+0000 7fab77fff640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab5803e930 0x7fab58040e40 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.645+0000 7fab757fa640 1 -- 172.21.15.97:0/4160179028 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fab68014380 con 0x7fab7809e170 2024-09-11T14:30:00.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.823+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fab7806fec0 con 0x7fab5803e930 2024-09-11T14:30:00.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.824+0000 7fab757fa640 1 -- 172.21.15.97:0/4160179028 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fab600070b0 con 0x7fab5803e930 2024-09-11T14:30:00.825 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab5803e930 msgr2=0x7fab58040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab5803e930 0x7fab58040e40 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab7809e170 msgr2=0x7fab78120b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab7809e170 0x7fab78120b70 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 shutdown_connections 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fab5803e930 0x7fab58040e40 unknown :-1 s=CLOSED pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 --2- 172.21.15.97:0/4160179028 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab7809e170 0x7fab78120b70 unknown :-1 s=CLOSED pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 >> 172.21.15.97:0/4160179028 conn(0x7fab7806f850 msgr2=0x7fab781bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 shutdown_connections 2024-09-11T14:30:00.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.826+0000 7fab7ef91640 1 -- 172.21.15.97:0/4160179028 wait complete. 2024-09-11T14:30:00.839 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T14:30:00.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:30:00.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.943+0000 7f141bd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.952+0000 7f141bd11640 1 Processor -- start 2024-09-11T14:30:00.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.952+0000 7f141bd11640 1 -- start start 2024-09-11T14:30:00.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.953+0000 7f141bd11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1414133900 0x7f1414138020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.953+0000 7f141bd11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1414074770 con 0x7f1414132de0 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.953+0000 7f141bd11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1414072580 con 0x7f1414133900 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.953+0000 7f14192ac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1414133900 0x7f1414138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.953+0000 7f14192ac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1414133900 0x7f1414138020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56556/0 (socket says 172.21.15.97:56556) 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.953+0000 7f14192ac640 1 -- 172.21.15.97:0/1215737122 learned_addr learned my addr 172.21.15.97:0/1215737122 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.953+0000 7f1419aad640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1414132de0 0x7f14141331f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52496/0 (socket says 172.21.15.97:52496) 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.954+0000 7f14192ac640 1 -- 172.21.15.97:0/1215737122 >> v1:172.21.15.97:6789/0 conn(0x7f1414132de0 legacy=0x7f14141331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.954+0000 7f14192ac640 1 -- 172.21.15.97:0/1215737122 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1414072710 con 0x7f1414133900 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.954+0000 7f1418aab640 1 -- 172.21.15.97:0/1215737122 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319548648 0 0) 0x7f1414074770 con 0x7f1414132de0 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.954+0000 7f14192ac640 1 --2- 172.21.15.97:0/1215737122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414133900 0x7f1414138020 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2f483dd7a2fa7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.954+0000 7f1418aab640 1 -- 172.21.15.97:0/1215737122 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1404009e50 con 0x7f1414133900 2024-09-11T14:30:00.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.954+0000 7f1418aab640 1 -- 172.21.15.97:0/1215737122 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f140400e230 con 0x7f1414133900 2024-09-11T14:30:00.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.954+0000 7f1418aab640 1 -- 172.21.15.97:0/1215737122 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f140400e4d0 con 0x7f1414133900 2024-09-11T14:30:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 1 -- 172.21.15.97:0/1215737122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414133900 msgr2=0x7f1414138020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 1 --2- 172.21.15.97:0/1215737122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414133900 0x7f1414138020 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 1 -- 172.21.15.97:0/1215737122 shutdown_connections 2024-09-11T14:30:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 1 --2- 172.21.15.97:0/1215737122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414133900 0x7f1414138020 unknown :-1 s=CLOSED pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 1 -- 172.21.15.97:0/1215737122 >> 172.21.15.97:0/1215737122 conn(0x7f14140a33b0 msgr2=0x7f14140a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 1 -- 172.21.15.97:0/1215737122 shutdown_connections 2024-09-11T14:30:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 1 -- 172.21.15.97:0/1215737122 wait complete. 2024-09-11T14:30:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.955+0000 7f141bd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.956+0000 7f141bd11640 1 Processor -- start 2024-09-11T14:30:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.957+0000 7f141bd11640 1 -- start start 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.957+0000 7f141bd11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414132de0 0x7f141411ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f141bd11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1414121ef0 con 0x7f1414132de0 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f1419aad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414132de0 0x7f141411ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f1419aad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414132de0 0x7f141411ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56570/0 (socket says 172.21.15.97:56570) 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f1419aad640 1 -- 172.21.15.97:0/2710257027 learned_addr learned my addr 172.21.15.97:0/2710257027 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f1419aad640 1 -- 172.21.15.97:0/2710257027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141411f6d0 con 0x7f1414132de0 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f1419aad640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414132de0 0x7f141411ff10 crc :-1 s=READY pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1410004b80 con 0x7f1414132de0 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1410004ce0 con 0x7f1414132de0 2024-09-11T14:30:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1410007120 con 0x7f1414132de0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141411fc80 con 0x7f1414132de0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.958+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14141235c0 con 0x7f1414132de0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.959+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14140744f0 con 0x7f1414132de0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.959+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f14100072d0 con 0x7f1414132de0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.960+0000 7f140a7fc640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f13f803e930 0x7f13f8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.960+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f141004fa30 con 0x7f1414132de0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.960+0000 7f140a7fc640 1 --2- 172.21.15.97:0/2710257027 >> v2:172.21.15.117:6808/4196478755 conn(0x7f13f8044a70 0x7f13f8046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.960+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 --> v2:172.21.15.117:6808/4196478755 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13f80475f0 con 0x7f13f8044a70 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.960+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7f141004fdc0 con 0x7f1414132de0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.960+0000 7f14192ac640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f13f803e930 0x7f13f8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:00.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.960+0000 7f14192ac640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f13f803e930 0x7f13f8040e40 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.961+0000 7f141a2ae640 1 --2- 172.21.15.97:0/2710257027 >> v2:172.21.15.117:6808/4196478755 conn(0x7f13f8044a70 0x7f13f8046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:30:00.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.964+0000 7f141a2ae640 1 --2- 172.21.15.97:0/2710257027 >> v2:172.21.15.117:6808/4196478755 conn(0x7f13f8044a70 0x7f13f8046f60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:00.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.966+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== osd.3 v2:172.21.15.117:6808/4196478755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f13f80475f0 con 0x7f13f8044a70 2024-09-11T14:30:00.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.970+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 --> v2:172.21.15.117:6808/4196478755 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f14140a4350 con 0x7f13f8044a70 2024-09-11T14:30:00.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.971+0000 7f140a7fc640 1 -- 172.21.15.97:0/2710257027 <== osd.3 v2:172.21.15.117:6808/4196478755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f140c00a820 con 0x7f13f8044a70 2024-09-11T14:30:00.973 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-11T14:30:00.973 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "" 2024-09-11T14:30:00.973 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 >> v2:172.21.15.117:6808/4196478755 conn(0x7f13f8044a70 msgr2=0x7f13f8046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 --2- 172.21.15.97:0/2710257027 >> v2:172.21.15.117:6808/4196478755 conn(0x7f13f8044a70 0x7f13f8046f60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f13f803e930 msgr2=0x7f13f8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f13f803e930 0x7f13f8040e40 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414132de0 msgr2=0x7f141411ff10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414132de0 0x7f141411ff10 crc :-1 s=READY pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 shutdown_connections 2024-09-11T14:30:00.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 --2- 172.21.15.97:0/2710257027 >> v2:172.21.15.117:6808/4196478755 conn(0x7f13f8044a70 0x7f13f8046f60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f13f803e930 0x7f13f8040e40 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 --2- 172.21.15.97:0/2710257027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1414132de0 0x7f141411ff10 unknown :-1 s=CLOSED pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:00.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 >> 172.21.15.97:0/2710257027 conn(0x7f14140a33b0 msgr2=0x7f14141b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:00.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 shutdown_connections 2024-09-11T14:30:00.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:00.972+0000 7f141bd11640 1 -- 172.21.15.97:0/2710257027 wait complete. 2024-09-11T14:30:00.984 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T14:30:01.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.087+0000 7fa3d5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:01.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.093+0000 7fa3d5191640 1 Processor -- start 2024-09-11T14:30:01.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.093+0000 7fa3d5191640 1 -- start start 2024-09-11T14:30:01.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.094+0000 7fa3d5191640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3d0130250 0x7fa3d0137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:01.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.094+0000 7fa3d5191640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d009ddb0 con 0x7fa3d012f730 2024-09-11T14:30:01.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.094+0000 7fa3d5191640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d009dfe0 con 0x7fa3d0130250 2024-09-11T14:30:01.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.094+0000 7fa3c659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3d0130250 0x7fa3d0137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:01.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.094+0000 7fa3ced9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa3d012f730 0x7fa3d012fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55248/0 (socket says 172.21.15.97:55248) 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.094+0000 7fa3c659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3d0130250 0x7fa3d0137ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50012/0 (socket says 172.21.15.97:50012) 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.094+0000 7fa3ced9d640 1 -- 172.21.15.97:0/1469614018 learned_addr learned my addr 172.21.15.97:0/1469614018 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.095+0000 7fa3c659c640 1 -- 172.21.15.97:0/1469614018 >> v1:172.21.15.97:6789/0 conn(0x7fa3d012f730 legacy=0x7fa3d012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.095+0000 7fa3c659c640 1 -- 172.21.15.97:0/1469614018 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d0098180 con 0x7fa3d0130250 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.095+0000 7fa3c659c640 1 --2- 172.21.15.97:0/1469614018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d0130250 0x7fa3d0137ec0 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cd9e6d2d823046 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.095+0000 7fa3ce59c640 1 -- 172.21.15.97:0/1469614018 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3b8009d90 con 0x7fa3d0130250 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.095+0000 7fa3ce59c640 1 -- 172.21.15.97:0/1469614018 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa3b800e230 con 0x7fa3d0130250 2024-09-11T14:30:01.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.095+0000 7fa3ce59c640 1 -- 172.21.15.97:0/1469614018 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3b800e4d0 con 0x7fa3d0130250 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 1 -- 172.21.15.97:0/1469614018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d0130250 msgr2=0x7fa3d0137ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 1 --2- 172.21.15.97:0/1469614018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d0130250 0x7fa3d0137ec0 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 1 -- 172.21.15.97:0/1469614018 shutdown_connections 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 1 --2- 172.21.15.97:0/1469614018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d0130250 0x7fa3d0137ec0 unknown :-1 s=CLOSED pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 1 -- 172.21.15.97:0/1469614018 >> 172.21.15.97:0/1469614018 conn(0x7fa3d00a11f0 msgr2=0x7fa3d00a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 1 -- 172.21.15.97:0/1469614018 shutdown_connections 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 1 -- 172.21.15.97:0/1469614018 wait complete. 2024-09-11T14:30:01.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.096+0000 7fa3d5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:01.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.097+0000 7fa3d5191640 1 Processor -- start 2024-09-11T14:30:01.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.098+0000 7fa3d5191640 1 -- start start 2024-09-11T14:30:01.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3d5191640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d012f730 0x7fa3d009b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:01.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3d5191640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d009ff20 con 0x7fa3d012f730 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3ced9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d012f730 0x7fa3d009b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3ced9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d012f730 0x7fa3d009b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50026/0 (socket says 172.21.15.97:50026) 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3ced9d640 1 -- 172.21.15.97:0/513565414 learned_addr learned my addr 172.21.15.97:0/513565414 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3ced9d640 1 -- 172.21.15.97:0/513565414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d00947a0 con 0x7fa3d012f730 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3ced9d640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d012f730 0x7fa3d009b680 crc :-1 s=READY pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3c7fff640 1 -- 172.21.15.97:0/513565414 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3c0005a60 con 0x7fa3d012f730 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3c7fff640 1 -- 172.21.15.97:0/513565414 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa3c0005bc0 con 0x7fa3d012f730 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d0094470 con 0x7fa3d012f730 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3c7fff640 1 -- 172.21.15.97:0/513565414 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa3c0005e60 con 0x7fa3d012f730 2024-09-11T14:30:01.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.099+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d012eb40 con 0x7fa3d012f730 2024-09-11T14:30:01.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.100+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d0092ba0 con 0x7fa3d012f730 2024-09-11T14:30:01.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.100+0000 7fa3c7fff640 1 -- 172.21.15.97:0/513565414 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa3c000c7f0 con 0x7fa3d012f730 2024-09-11T14:30:01.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.100+0000 7fa3c7fff640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa3b003e930 0x7fa3b0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:01.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.101+0000 7fa3c7fff640 1 -- 172.21.15.97:0/513565414 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7fa3c004f8e0 con 0x7fa3d012f730 2024-09-11T14:30:01.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.101+0000 7fa3c659c640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa3b003e930 0x7fa3b0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:01.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.101+0000 7fa3c659c640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa3b003e930 0x7fa3b0040e40 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:01.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.106+0000 7fa3c7fff640 1 -- 172.21.15.97:0/513565414 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa3c000dc10 con 0x7fa3d012f730 2024-09-11T14:30:01.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.282+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa3d0098a10 con 0x7fa3b003e930 2024-09-11T14:30:01.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.283+0000 7fa3c7fff640 1 -- 172.21.15.97:0/513565414 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fa3b8009e80 con 0x7fa3b003e930 2024-09-11T14:30:01.284 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T14:30:01.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa3b003e930 msgr2=0x7fa3b0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa3b003e930 0x7fa3b0040e40 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d012f730 msgr2=0x7fa3d009b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d012f730 0x7fa3d009b680 crc :-1 s=READY pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 shutdown_connections 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7fa3b003e930 0x7fa3b0040e40 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 --2- 172.21.15.97:0/513565414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3d012f730 0x7fa3d009b680 unknown :-1 s=CLOSED pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 >> 172.21.15.97:0/513565414 conn(0x7fa3d00a11f0 msgr2=0x7fa3d0099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 shutdown_connections 2024-09-11T14:30:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.285+0000 7fa3d5191640 1 -- 172.21.15.97:0/513565414 wait complete. 2024-09-11T14:30:01.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:30:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.401+0000 7f97e22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.406+0000 7f97e22d1640 1 Processor -- start 2024-09-11T14:30:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.406+0000 7f97e22d1640 1 -- start start 2024-09-11T14:30:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.407+0000 7f97e22d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97dc09d160 0x7f97dc138f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.407+0000 7f97e22d1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97dc0a48c0 con 0x7f97dc09dad0 2024-09-11T14:30:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.407+0000 7f97e22d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f97dc06d1d0 con 0x7f97dc09d160 2024-09-11T14:30:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97dbfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f97dc09dad0 0x7f97dc09ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55260/0 (socket says 172.21.15.97:55260) 2024-09-11T14:30:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97dbfff640 1 -- 172.21.15.97:0/1728907727 learned_addr learned my addr 172.21.15.97:0/1728907727 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:30:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97db7fe640 1 --2- 172.21.15.97:0/1728907727 >> v2:172.21.15.97:3300/0 conn(0x7f97dc09d160 0x7f97dc138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97db7fe640 1 -- 172.21.15.97:0/1728907727 >> v1:172.21.15.97:6789/0 conn(0x7f97dc09dad0 legacy=0x7f97dc09ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97daffd640 1 -- 172.21.15.97:0/1728907727 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546619103 0 0) 0x7f97dc0a48c0 con 0x7f97dc09dad0 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97db7fe640 1 -- 172.21.15.97:0/1728907727 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc0a45b0 con 0x7f97dc09d160 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97db7fe640 1 --2- 172.21.15.97:0/1728907727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc138f10 crc :-1 s=READY pgs=13035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2ff93586673a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97daffd640 1 -- 172.21.15.97:0/1728907727 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97d0009d80 con 0x7f97dc09d160 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97daffd640 1 -- 172.21.15.97:0/1728907727 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f97d000e230 con 0x7f97dc09d160 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.408+0000 7f97daffd640 1 -- 172.21.15.97:0/1728907727 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97d000e4d0 con 0x7f97dc09d160 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 1 -- 172.21.15.97:0/1728907727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 msgr2=0x7f97dc138f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 1 --2- 172.21.15.97:0/1728907727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc138f10 crc :-1 s=READY pgs=13035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 1 -- 172.21.15.97:0/1728907727 shutdown_connections 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 1 --2- 172.21.15.97:0/1728907727 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc138f10 unknown :-1 s=CLOSED pgs=13035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 1 -- 172.21.15.97:0/1728907727 >> 172.21.15.97:0/1728907727 conn(0x7f97dc0a2970 msgr2=0x7f97dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 1 -- 172.21.15.97:0/1728907727 shutdown_connections 2024-09-11T14:30:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 1 -- 172.21.15.97:0/1728907727 wait complete. 2024-09-11T14:30:01.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.409+0000 7f97e22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.411+0000 7f97e22d1640 1 Processor -- start 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.411+0000 7f97e22d1640 1 -- start start 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.412+0000 7f97e22d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc11ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.412+0000 7f97e22d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc11e1f0 con 0x7f97dc09d160 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.412+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc11ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.412+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc11ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50054/0 (socket says 172.21.15.97:50054) 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.412+0000 7f97dbfff640 1 -- 172.21.15.97:0/1704369742 learned_addr learned my addr 172.21.15.97:0/1704369742 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.412+0000 7f97dbfff640 1 -- 172.21.15.97:0/1704369742 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc120e50 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.412+0000 7f97dbfff640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc11ceb0 crc :-1 s=READY pgs=13036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.413+0000 7f97d8ff9640 1 -- 172.21.15.97:0/1704369742 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97cc004b80 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.413+0000 7f97d8ff9640 1 -- 172.21.15.97:0/1704369742 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f97cc004ce0 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.413+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc11e8f0 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.413+0000 7f97d8ff9640 1 -- 172.21.15.97:0/1704369742 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97cc007120 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.413+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc120a90 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.414+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97dc09dad0 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.414+0000 7f97d8ff9640 1 -- 172.21.15.97:0/1704369742 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f97cc0072d0 con 0x7f97dc09d160 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.414+0000 7f97d8ff9640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f97c803e930 0x7f97c8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.414+0000 7f97d8ff9640 1 -- 172.21.15.97:0/1704369742 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f97cc04fa50 con 0x7f97dc09d160 2024-09-11T14:30:01.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.414+0000 7f97db7fe640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f97c803e930 0x7f97c8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:01.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.415+0000 7f97db7fe640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f97c803e930 0x7f97c8040e40 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.419+0000 7f97d8ff9640 1 -- 172.21.15.97:0/1704369742 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f97cc051e60 con 0x7f97dc09d160 2024-09-11T14:30:01.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.624+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97dc09d570 con 0x7f97c803e930 2024-09-11T14:30:01.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.626+0000 7f97d8ff9640 1 -- 172.21.15.97:0/1704369742 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109237 (crc 0 0 0) 0x7f97d0009cd0 con 0x7f97c803e930 2024-09-11T14:30:01.628 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:30:01.629 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:30:01.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.628+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f97c803e930 msgr2=0x7f97c8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.628+0000 7f97e22d1640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f97c803e930 0x7f97c8040e40 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.628+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 msgr2=0x7f97dc11ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:01.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.628+0000 7f97e22d1640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc11ceb0 crc :-1 s=READY pgs=13036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.628+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 shutdown_connections 2024-09-11T14:30:01.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.628+0000 7f97e22d1640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f97c803e930 0x7f97c8040e40 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.629+0000 7f97e22d1640 1 --2- 172.21.15.97:0/1704369742 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97dc09d160 0x7f97dc11ceb0 unknown :-1 s=CLOSED pgs=13036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:01.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.629+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 >> 172.21.15.97:0/1704369742 conn(0x7f97dc0a2970 msgr2=0x7f97dc130410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:01.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.629+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 shutdown_connections 2024-09-11T14:30:01.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:01.629+0000 7f97e22d1640 1 -- 172.21.15.97:0/1704369742 wait complete. 2024-09-11T14:30:01.642 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1285,"stamp":"2024-09-11T14:30:00.799242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259128,"kb_used_data":14380,"kb_used_omap":0,"kb_used_meta":244672,"kb_avail":377228232,"statfs":{"total":386547056640,"available":386281709568,"internally_reserved":0,"allocated":14725120,"data_stored":7210725,"data_compressed":354490,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":250544128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002019"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504619+0000","last_change":"2024-09-11T14:16:01.478105+0000","last_active":"2024-09-11T14:29:55.504619+0000","last_peered":"2024-09-11T14:29:55.504619+0000","last_clean":"2024-09-11T14:29:55.504619+0000","last_became_active":"2024-09-11T14:16:01.469796+0000","last_became_peered":"2024-09-11T14:16:01.469796+0000","last_unstale":"2024-09-11T14:29:55.504619+0000","last_undegraded":"2024-09-11T14:29:55.504619+0000","last_fullsized":"2024-09-11T14:29:55.504619+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.505673+0000","last_change":"2024-09-11T14:16:01.566671+0000","last_active":"2024-09-11T14:29:55.505673+0000","last_peered":"2024-09-11T14:29:55.505673+0000","last_clean":"2024-09-11T14:29:55.505673+0000","last_became_active":"2024-09-11T14:16:01.553483+0000","last_became_peered":"2024-09-11T14:16:01.553483+0000","last_unstale":"2024-09-11T14:29:55.505673+0000","last_undegraded":"2024-09-11T14:29:55.505673+0000","last_fullsized":"2024-09-11T14:29:55.505673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.500570+0000","last_change":"2024-09-11T14:16:01.491814+0000","last_active":"2024-09-11T14:29:55.500570+0000","last_peered":"2024-09-11T14:29:55.500570+0000","last_clean":"2024-09-11T14:29:55.500570+0000","last_became_active":"2024-09-11T14:16:01.485851+0000","last_became_peered":"2024-09-11T14:16:01.485851+0000","last_unstale":"2024-09-11T14:29:55.500570+0000","last_undegraded":"2024-09-11T14:29:55.500570+0000","last_fullsized":"2024-09-11T14:29:55.500570+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.488003+0000","last_change":"2024-09-11T14:16:01.497743+0000","last_active":"2024-09-11T14:29:55.488003+0000","last_peered":"2024-09-11T14:29:55.488003+0000","last_clean":"2024-09-11T14:29:55.488003+0000","last_became_active":"2024-09-11T14:16:01.469079+0000","last_became_peered":"2024-09-11T14:16:01.469079+0000","last_unstale":"2024-09-11T14:29:55.488003+0000","last_undegraded":"2024-09-11T14:29:55.488003+0000","last_fullsized":"2024-09-11T14:29:55.488003+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489764+0000","last_change":"2024-09-11T14:16:01.492881+0000","last_active":"2024-09-11T14:29:55.489764+0000","last_peered":"2024-09-11T14:29:55.489764+0000","last_clean":"2024-09-11T14:29:55.489764+0000","last_became_active":"2024-09-11T14:16:01.480473+0000","last_became_peered":"2024-09-11T14:16:01.480473+0000","last_unstale":"2024-09-11T14:29:55.489764+0000","last_undegraded":"2024-09-11T14:29:55.489764+0000","last_fullsized":"2024-09-11T14:29:55.489764+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.490446+0000","last_change":"2024-09-11T14:16:01.541899+0000","last_active":"2024-09-11T14:29:55.490446+0000","last_peered":"2024-09-11T14:29:55.490446+0000","last_clean":"2024-09-11T14:29:55.490446+0000","last_became_active":"2024-09-11T14:16:01.515259+0000","last_became_peered":"2024-09-11T14:16:01.515259+0000","last_unstale":"2024-09-11T14:29:55.490446+0000","last_undegraded":"2024-09-11T14:29:55.490446+0000","last_fullsized":"2024-09-11T14:29:55.490446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515043+0000","last_change":"2024-09-11T14:16:01.523684+0000","last_active":"2024-09-11T14:29:55.515043+0000","last_peered":"2024-09-11T14:29:55.515043+0000","last_clean":"2024-09-11T14:29:55.515043+0000","last_became_active":"2024-09-11T14:16:01.510524+0000","last_became_peered":"2024-09-11T14:16:01.510524+0000","last_unstale":"2024-09-11T14:29:55.515043+0000","last_undegraded":"2024-09-11T14:29:55.515043+0000","last_fullsized":"2024-09-11T14:29:55.515043+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523629+0000","last_change":"2024-09-11T14:16:01.525329+0000","last_active":"2024-09-11T14:29:55.523629+0000","last_peered":"2024-09-11T14:29:55.523629+0000","last_clean":"2024-09-11T14:29:55.523629+0000","last_became_active":"2024-09-11T14:16:01.514773+0000","last_became_peered":"2024-09-11T14:16:01.514773+0000","last_unstale":"2024-09-11T14:29:55.523629+0000","last_undegraded":"2024-09-11T14:29:55.523629+0000","last_fullsized":"2024-09-11T14:29:55.523629+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.498084+0000","last_change":"2024-09-11T14:16:01.533436+0000","last_active":"2024-09-11T14:29:55.498084+0000","last_peered":"2024-09-11T14:29:55.498084+0000","last_clean":"2024-09-11T14:29:55.498084+0000","last_became_active":"2024-09-11T14:16:01.525822+0000","last_became_peered":"2024-09-11T14:16:01.525822+0000","last_unstale":"2024-09-11T14:29:55.498084+0000","last_undegraded":"2024-09-11T14:29:55.498084+0000","last_fullsized":"2024-09-11T14:29:55.498084+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.487709+0000","last_change":"2024-09-11T14:16:01.514314+0000","last_active":"2024-09-11T14:29:55.487709+0000","last_peered":"2024-09-11T14:29:55.487709+0000","last_clean":"2024-09-11T14:29:55.487709+0000","last_became_active":"2024-09-11T14:16:01.499412+0000","last_became_peered":"2024-09-11T14:16:01.499412+0000","last_unstale":"2024-09-11T14:29:55.487709+0000","last_undegraded":"2024-09-11T14:29:55.487709+0000","last_fullsized":"2024-09-11T14:29:55.487709+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.507704+0000","last_change":"2024-09-11T14:16:01.517824+0000","last_active":"2024-09-11T14:29:55.507704+0000","last_peered":"2024-09-11T14:29:55.507704+0000","last_clean":"2024-09-11T14:29:55.507704+0000","last_became_active":"2024-09-11T14:16:01.507489+0000","last_became_peered":"2024-09-11T14:16:01.507489+0000","last_unstale":"2024-09-11T14:29:55.507704+0000","last_undegraded":"2024-09-11T14:29:55.507704+0000","last_fullsized":"2024-09-11T14:29:55.507704+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523786+0000","last_change":"2024-09-11T14:16:01.572297+0000","last_active":"2024-09-11T14:29:55.523786+0000","last_peered":"2024-09-11T14:29:55.523786+0000","last_clean":"2024-09-11T14:29:55.523786+0000","last_became_active":"2024-09-11T14:16:01.564983+0000","last_became_peered":"2024-09-11T14:16:01.564983+0000","last_unstale":"2024-09-11T14:29:55.523786+0000","last_undegraded":"2024-09-11T14:29:55.523786+0000","last_fullsized":"2024-09-11T14:29:55.523786+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.492434+0000","last_change":"2024-09-11T14:16:01.553374+0000","last_active":"2024-09-11T14:29:55.492434+0000","last_peered":"2024-09-11T14:29:55.492434+0000","last_clean":"2024-09-11T14:29:55.492434+0000","last_became_active":"2024-09-11T14:16:01.546695+0000","last_became_peered":"2024-09-11T14:16:01.546695+0000","last_unstale":"2024-09-11T14:29:55.492434+0000","last_undegraded":"2024-09-11T14:29:55.492434+0000","last_fullsized":"2024-09-11T14:29:55.492434+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.494645+0000","last_change":"2024-09-11T14:16:01.549306+0000","last_active":"2024-09-11T14:29:55.494645+0000","last_peered":"2024-09-11T14:29:55.494645+0000","last_clean":"2024-09-11T14:29:55.494645+0000","last_became_active":"2024-09-11T14:16:01.541719+0000","last_became_peered":"2024-09-11T14:16:01.541719+0000","last_unstale":"2024-09-11T14:29:55.494645+0000","last_undegraded":"2024-09-11T14:29:55.494645+0000","last_fullsized":"2024-09-11T14:29:55.494645+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511367+0000","last_change":"2024-09-11T14:16:01.609878+0000","last_active":"2024-09-11T14:29:55.511367+0000","last_peered":"2024-09-11T14:29:55.511367+0000","last_clean":"2024-09-11T14:29:55.511367+0000","last_became_active":"2024-09-11T14:16:01.598547+0000","last_became_peered":"2024-09-11T14:16:01.598547+0000","last_unstale":"2024-09-11T14:29:55.511367+0000","last_undegraded":"2024-09-11T14:29:55.511367+0000","last_fullsized":"2024-09-11T14:29:55.511367+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.493382+0000","last_change":"2024-09-11T14:16:01.555603+0000","last_active":"2024-09-11T14:29:55.493382+0000","last_peered":"2024-09-11T14:29:55.493382+0000","last_clean":"2024-09-11T14:29:55.493382+0000","last_became_active":"2024-09-11T14:16:01.528427+0000","last_became_peered":"2024-09-11T14:16:01.528427+0000","last_unstale":"2024-09-11T14:29:55.493382+0000","last_undegraded":"2024-09-11T14:29:55.493382+0000","last_fullsized":"2024-09-11T14:29:55.493382+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.532842+0000","last_change":"2024-09-11T14:16:01.556304+0000","last_active":"2024-09-11T14:29:55.532842+0000","last_peered":"2024-09-11T14:29:55.532842+0000","last_clean":"2024-09-11T14:29:55.532842+0000","last_became_active":"2024-09-11T14:16:01.540687+0000","last_became_peered":"2024-09-11T14:16:01.540687+0000","last_unstale":"2024-09-11T14:29:55.532842+0000","last_undegraded":"2024-09-11T14:29:55.532842+0000","last_fullsized":"2024-09-11T14:29:55.532842+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497272+0000","last_change":"2024-09-11T14:16:01.494968+0000","last_active":"2024-09-11T14:29:55.497272+0000","last_peered":"2024-09-11T14:29:55.497272+0000","last_clean":"2024-09-11T14:29:55.497272+0000","last_became_active":"2024-09-11T14:16:01.475901+0000","last_became_peered":"2024-09-11T14:16:01.475901+0000","last_unstale":"2024-09-11T14:29:55.497272+0000","last_undegraded":"2024-09-11T14:29:55.497272+0000","last_fullsized":"2024-09-11T14:29:55.497272+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504034+0000","last_change":"2024-09-11T14:16:01.496009+0000","last_active":"2024-09-11T14:29:55.504034+0000","last_peered":"2024-09-11T14:29:55.504034+0000","last_clean":"2024-09-11T14:29:55.504034+0000","last_became_active":"2024-09-11T14:16:01.485861+0000","last_became_peered":"2024-09-11T14:16:01.485861+0000","last_unstale":"2024-09-11T14:29:55.504034+0000","last_undegraded":"2024-09-11T14:29:55.504034+0000","last_fullsized":"2024-09-11T14:29:55.504034+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503865+0000","last_change":"2024-09-11T14:16:01.511330+0000","last_active":"2024-09-11T14:29:55.503865+0000","last_peered":"2024-09-11T14:29:55.503865+0000","last_clean":"2024-09-11T14:29:55.503865+0000","last_became_active":"2024-09-11T14:16:01.497752+0000","last_became_peered":"2024-09-11T14:16:01.497752+0000","last_unstale":"2024-09-11T14:29:55.503865+0000","last_undegraded":"2024-09-11T14:29:55.503865+0000","last_fullsized":"2024-09-11T14:29:55.503865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503010+0000","last_change":"2024-09-11T14:16:01.548238+0000","last_active":"2024-09-11T14:29:55.503010+0000","last_peered":"2024-09-11T14:29:55.503010+0000","last_clean":"2024-09-11T14:29:55.503010+0000","last_became_active":"2024-09-11T14:16:01.540272+0000","last_became_peered":"2024-09-11T14:16:01.540272+0000","last_unstale":"2024-09-11T14:29:55.503010+0000","last_undegraded":"2024-09-11T14:29:55.503010+0000","last_fullsized":"2024-09-11T14:29:55.503010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491594+0000","last_change":"2024-09-11T14:16:01.530012+0000","last_active":"2024-09-11T14:29:55.491594+0000","last_peered":"2024-09-11T14:29:55.491594+0000","last_clean":"2024-09-11T14:29:55.491594+0000","last_became_active":"2024-09-11T14:16:01.516906+0000","last_became_peered":"2024-09-11T14:16:01.516906+0000","last_unstale":"2024-09-11T14:29:55.491594+0000","last_undegraded":"2024-09-11T14:29:55.491594+0000","last_fullsized":"2024-09-11T14:29:55.491594+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.501848+0000","last_change":"2024-09-11T14:16:01.535163+0000","last_active":"2024-09-11T14:29:55.501848+0000","last_peered":"2024-09-11T14:29:55.501848+0000","last_clean":"2024-09-11T14:29:55.501848+0000","last_became_active":"2024-09-11T14:16:01.524168+0000","last_became_peered":"2024-09-11T14:16:01.524168+0000","last_unstale":"2024-09-11T14:29:55.501848+0000","last_undegraded":"2024-09-11T14:29:55.501848+0000","last_fullsized":"2024-09-11T14:29:55.501848+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.520363+0000","last_change":"2024-09-11T14:16:01.525020+0000","last_active":"2024-09-11T14:29:55.520363+0000","last_peered":"2024-09-11T14:29:55.520363+0000","last_clean":"2024-09-11T14:29:55.520363+0000","last_became_active":"2024-09-11T14:16:01.519043+0000","last_became_peered":"2024-09-11T14:16:01.519043+0000","last_unstale":"2024-09-11T14:29:55.520363+0000","last_undegraded":"2024-09-11T14:29:55.520363+0000","last_fullsized":"2024-09-11T14:29:55.520363+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511420+0000","last_change":"2024-09-11T14:16:01.514997+0000","last_active":"2024-09-11T14:29:55.511420+0000","last_peered":"2024-09-11T14:29:55.511420+0000","last_clean":"2024-09-11T14:29:55.511420+0000","last_became_active":"2024-09-11T14:16:01.508423+0000","last_became_peered":"2024-09-11T14:16:01.508423+0000","last_unstale":"2024-09-11T14:29:55.511420+0000","last_undegraded":"2024-09-11T14:29:55.511420+0000","last_fullsized":"2024-09-11T14:29:55.511420+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523289+0000","last_change":"2024-09-11T14:16:01.528298+0000","last_active":"2024-09-11T14:29:55.523289+0000","last_peered":"2024-09-11T14:29:55.523289+0000","last_clean":"2024-09-11T14:29:55.523289+0000","last_became_active":"2024-09-11T14:16:01.505280+0000","last_became_peered":"2024-09-11T14:16:01.505280+0000","last_unstale":"2024-09-11T14:29:55.523289+0000","last_undegraded":"2024-09-11T14:29:55.523289+0000","last_fullsized":"2024-09-11T14:29:55.523289+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511025+0000","last_change":"2024-09-11T14:16:01.582504+0000","last_active":"2024-09-11T14:29:55.511025+0000","last_peered":"2024-09-11T14:29:55.511025+0000","last_clean":"2024-09-11T14:29:55.511025+0000","last_became_active":"2024-09-11T14:16:01.573403+0000","last_became_peered":"2024-09-11T14:16:01.573403+0000","last_unstale":"2024-09-11T14:29:55.511025+0000","last_undegraded":"2024-09-11T14:29:55.511025+0000","last_fullsized":"2024-09-11T14:29:55.511025+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.525031+0000","last_change":"2024-09-11T14:16:01.614988+0000","last_active":"2024-09-11T14:29:55.525031+0000","last_peered":"2024-09-11T14:29:55.525031+0000","last_clean":"2024-09-11T14:29:55.525031+0000","last_became_active":"2024-09-11T14:16:01.607437+0000","last_became_peered":"2024-09-11T14:16:01.607437+0000","last_unstale":"2024-09-11T14:29:55.525031+0000","last_undegraded":"2024-09-11T14:29:55.525031+0000","last_fullsized":"2024-09-11T14:29:55.525031+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.517913+0000","last_change":"2024-09-11T14:16:01.537504+0000","last_active":"2024-09-11T14:29:55.517913+0000","last_peered":"2024-09-11T14:29:55.517913+0000","last_clean":"2024-09-11T14:29:55.517913+0000","last_became_active":"2024-09-11T14:16:01.520713+0000","last_became_peered":"2024-09-11T14:16:01.520713+0000","last_unstale":"2024-09-11T14:29:55.517913+0000","last_undegraded":"2024-09-11T14:29:55.517913+0000","last_fullsized":"2024-09-11T14:29:55.517913+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.509228+0000","last_change":"2024-09-11T14:16:01.486527+0000","last_active":"2024-09-11T14:29:55.509228+0000","last_peered":"2024-09-11T14:29:55.509228+0000","last_clean":"2024-09-11T14:29:55.509228+0000","last_became_active":"2024-09-11T14:16:01.470273+0000","last_became_peered":"2024-09-11T14:16:01.470273+0000","last_unstale":"2024-09-11T14:29:55.509228+0000","last_undegraded":"2024-09-11T14:29:55.509228+0000","last_fullsized":"2024-09-11T14:29:55.509228+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1467,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515484+0000","last_change":"2024-09-11T14:16:01.518850+0000","last_active":"2024-09-11T14:29:55.515484+0000","last_peered":"2024-09-11T14:29:55.515484+0000","last_clean":"2024-09-11T14:29:55.515484+0000","last_became_active":"2024-09-11T14:16:01.504043+0000","last_became_peered":"2024-09-11T14:16:01.504043+0000","last_unstale":"2024-09-11T14:29:55.515484+0000","last_undegraded":"2024-09-11T14:29:55.515484+0000","last_fullsized":"2024-09-11T14:29:55.515484+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.502154+0000","last_change":"2024-09-11T14:16:01.490663+0000","last_active":"2024-09-11T14:29:55.502154+0000","last_peered":"2024-09-11T14:29:55.502154+0000","last_clean":"2024-09-11T14:29:55.502154+0000","last_became_active":"2024-09-11T14:16:01.479206+0000","last_became_peered":"2024-09-11T14:16:01.479206+0000","last_unstale":"2024-09-11T14:29:55.502154+0000","last_undegraded":"2024-09-11T14:29:55.502154+0000","last_fullsized":"2024-09-11T14:29:55.502154+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506288+0000","last_change":"2024-09-11T14:11:01.590400+0000","last_active":"2024-09-11T14:29:55.506288+0000","last_peered":"2024-09-11T14:29:55.506288+0000","last_clean":"2024-09-11T14:29:55.506288+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:29:55.506288+0000","last_undegraded":"2024-09-11T14:29:55.506288+0000","last_fullsized":"2024-09-11T14:29:55.506288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491586+0000","last_change":"2024-09-11T14:11:01.587732+0000","last_active":"2024-09-11T14:29:55.491586+0000","last_peered":"2024-09-11T14:29:55.491586+0000","last_clean":"2024-09-11T14:29:55.491586+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:29:55.491586+0000","last_undegraded":"2024-09-11T14:29:55.491586+0000","last_fullsized":"2024-09-11T14:29:55.491586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506562+0000","last_change":"2024-09-11T14:11:01.587844+0000","last_active":"2024-09-11T14:29:55.506562+0000","last_peered":"2024-09-11T14:29:55.506562+0000","last_clean":"2024-09-11T14:29:55.506562+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:29:55.506562+0000","last_undegraded":"2024-09-11T14:29:55.506562+0000","last_fullsized":"2024-09-11T14:29:55.506562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489183+0000","last_change":"2024-09-11T14:11:01.585502+0000","last_active":"2024-09-11T14:29:55.489183+0000","last_peered":"2024-09-11T14:29:55.489183+0000","last_clean":"2024-09-11T14:29:55.489183+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:29:55.489183+0000","last_undegraded":"2024-09-11T14:29:55.489183+0000","last_fullsized":"2024-09-11T14:29:55.489183+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":2132,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.516852+0000","last_change":"2024-09-11T14:11:01.588321+0000","last_active":"2024-09-11T14:29:55.516852+0000","last_peered":"2024-09-11T14:29:55.516852+0000","last_clean":"2024-09-11T14:29:55.516852+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:29:55.516852+0000","last_undegraded":"2024-09-11T14:29:55.516852+0000","last_fullsized":"2024-09-11T14:29:55.516852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497120+0000","last_change":"2024-09-11T14:11:01.587060+0000","last_active":"2024-09-11T14:29:55.497120+0000","last_peered":"2024-09-11T14:29:55.497120+0000","last_clean":"2024-09-11T14:29:55.497120+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:29:55.497120+0000","last_undegraded":"2024-09-11T14:29:55.497120+0000","last_fullsized":"2024-09-11T14:29:55.497120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.536047+0000","last_change":"2024-09-11T14:11:01.589239+0000","last_active":"2024-09-11T14:29:55.536047+0000","last_peered":"2024-09-11T14:29:55.536047+0000","last_clean":"2024-09-11T14:29:55.536047+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:29:55.536047+0000","last_undegraded":"2024-09-11T14:29:55.536047+0000","last_fullsized":"2024-09-11T14:29:55.536047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":2131,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506831+0000","last_change":"2024-09-11T14:11:01.590912+0000","last_active":"2024-09-11T14:29:55.506831+0000","last_peered":"2024-09-11T14:29:55.506831+0000","last_clean":"2024-09-11T14:29:55.506831+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:29:55.506831+0000","last_undegraded":"2024-09-11T14:29:55.506831+0000","last_fullsized":"2024-09-11T14:29:55.506831+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2199,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489882+0000","last_change":"2024-09-11T14:10:58.605266+0000","last_active":"2024-09-11T14:29:55.489882+0000","last_peered":"2024-09-11T14:29:55.489882+0000","last_clean":"2024-09-11T14:29:55.489882+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:29:55.489882+0000","last_undegraded":"2024-09-11T14:29:55.489882+0000","last_fullsized":"2024-09-11T14:29:55.489882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70724,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301116,"statfs":{"total":96636764160,"available":96564342784,"internally_reserved":0,"allocated":3710976,"data_stored":2103141,"data_compressed":106589,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66488,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305352,"statfs":{"total":96636764160,"available":96568680448,"internally_reserved":0,"allocated":3645440,"data_stored":1500020,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60904,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310936,"statfs":{"total":96636764160,"available":96574398464,"internally_reserved":0,"allocated":3629056,"data_stored":1487224,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61012,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310828,"statfs":{"total":96636764160,"available":96574287872,"internally_reserved":0,"allocated":3739648,"data_stored":2120340,"data_compressed":112477,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:30:01.649 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.649 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.649 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.649 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.649 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.649 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.650 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.651 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.652 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.653 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.653 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.653 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.653 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.656 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.656 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.657 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.657 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T14:10:57.546724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=57, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:01.657 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T14:30:21.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:30:21.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.775+0000 7f771af11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:21.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.780+0000 7f771af11640 1 Processor -- start 2024-09-11T14:30:21.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.780+0000 7f771af11640 1 -- start start 2024-09-11T14:30:21.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f771af11640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7714135570 0x7f7714137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:21.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f771af11640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7714098840 con 0x7f7714132790 2024-09-11T14:30:21.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f771af11640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f771409ac90 con 0x7f7714135570 2024-09-11T14:30:21.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f770bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7714135570 0x7f7714137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:21.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f7718cad640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7714132790 0x7f7714132ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56088/0 (socket says 172.21.15.97:56088) 2024-09-11T14:30:21.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f7718cad640 1 -- 172.21.15.97:0/716158090 learned_addr learned my addr 172.21.15.97:0/716158090 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-11T14:30:21.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f770bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7714135570 0x7f7714137990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55632/0 (socket says 172.21.15.97:55632) 2024-09-11T14:30:21.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.781+0000 7f770bfff640 1 -- 172.21.15.97:0/716158090 >> v1:172.21.15.97:6789/0 conn(0x7f7714132790 legacy=0x7f7714132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:21.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.782+0000 7f770bfff640 1 -- 172.21.15.97:0/716158090 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771409cb70 con 0x7f7714135570 2024-09-11T14:30:21.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.782+0000 7f770bfff640 1 --2- 172.21.15.97:0/716158090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714135570 0x7f7714137990 crc :-1 s=READY pgs=13038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8a838e175ec041 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:21.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.782+0000 7f770b7fe640 1 -- 172.21.15.97:0/716158090 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7704009d80 con 0x7f7714135570 2024-09-11T14:30:21.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.782+0000 7f770b7fe640 1 -- 172.21.15.97:0/716158090 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f770400e230 con 0x7f7714135570 2024-09-11T14:30:21.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.782+0000 7f770b7fe640 1 -- 172.21.15.97:0/716158090 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f770400e4d0 con 0x7f7714135570 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 1 -- 172.21.15.97:0/716158090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714135570 msgr2=0x7f7714137990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 1 --2- 172.21.15.97:0/716158090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714135570 0x7f7714137990 crc :-1 s=READY pgs=13038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 1 -- 172.21.15.97:0/716158090 shutdown_connections 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 1 --2- 172.21.15.97:0/716158090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714135570 0x7f7714137990 unknown :-1 s=CLOSED pgs=13038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 1 -- 172.21.15.97:0/716158090 >> 172.21.15.97:0/716158090 conn(0x7f77140a11f0 msgr2=0x7f77140a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 1 -- 172.21.15.97:0/716158090 shutdown_connections 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 1 -- 172.21.15.97:0/716158090 wait complete. 2024-09-11T14:30:21.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.783+0000 7f771af11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:21.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.784+0000 7f771af11640 1 Processor -- start 2024-09-11T14:30:21.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.784+0000 7f771af11640 1 -- start start 2024-09-11T14:30:21.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.785+0000 7f771af11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714132790 0x7f77140717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:21.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.785+0000 7f771af11640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7714134190 con 0x7f7714132790 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.785+0000 7f7718cad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714132790 0x7f77140717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f7718cad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714132790 0x7f77140717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55636/0 (socket says 172.21.15.97:55636) 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f7718cad640 1 -- 172.21.15.97:0/1200449788 learned_addr learned my addr 172.21.15.97:0/1200449788 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f7718cad640 1 -- 172.21.15.97:0/1200449788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77140737d0 con 0x7f7714132790 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f7718cad640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714132790 0x7f77140717e0 crc :-1 s=READY pgs=13039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f77097fa640 1 -- 172.21.15.97:0/1200449788 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7710005a60 con 0x7f7714132790 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f77097fa640 1 -- 172.21.15.97:0/1200449788 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7710005bc0 con 0x7f7714132790 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77140748d0 con 0x7f7714132790 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f77097fa640 1 -- 172.21.15.97:0/1200449788 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7710005e60 con 0x7f7714132790 2024-09-11T14:30:21.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.786+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141398a0 con 0x7f7714132790 2024-09-11T14:30:21.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.787+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7714074740 con 0x7f7714132790 2024-09-11T14:30:21.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.787+0000 7f77097fa640 1 -- 172.21.15.97:0/1200449788 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f77100070b0 con 0x7f7714132790 2024-09-11T14:30:21.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.787+0000 7f77097fa640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f770003e930 0x7f7700040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:21.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.788+0000 7f77097fa640 1 -- 172.21.15.97:0/1200449788 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f771004f8d0 con 0x7f7714132790 2024-09-11T14:30:21.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.788+0000 7f770bfff640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f770003e930 0x7f7700040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:21.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.788+0000 7f770bfff640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f770003e930 0x7f7700040e40 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:21.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.793+0000 7f77097fa640 1 -- 172.21.15.97:0/1200449788 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f771000dc60 con 0x7f7714132790 2024-09-11T14:30:21.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.965+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7714074520 con 0x7f770003e930 2024-09-11T14:30:21.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.967+0000 7f77097fa640 1 -- 172.21.15.97:0/1200449788 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109223 (crc 0 0 0) 0x7f7704009e70 con 0x7f770003e930 2024-09-11T14:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:30:21.970 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f770003e930 msgr2=0x7f7700040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f770003e930 0x7f7700040e40 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714132790 msgr2=0x7f77140717e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714132790 0x7f77140717e0 crc :-1 s=READY pgs=13039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 shutdown_connections 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f770003e930 0x7f7700040e40 unknown :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 --2- 172.21.15.97:0/1200449788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714132790 0x7f77140717e0 unknown :-1 s=CLOSED pgs=13039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:21.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 >> 172.21.15.97:0/1200449788 conn(0x7f77140a11f0 msgr2=0x7f7714131130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:21.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 shutdown_connections 2024-09-11T14:30:21.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:21.970+0000 7f771af11640 1 -- 172.21.15.97:0/1200449788 wait complete. 2024-09-11T14:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1295,"stamp":"2024-09-11T14:30:20.804532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259128,"kb_used_data":14380,"kb_used_omap":0,"kb_used_meta":244672,"kb_avail":377228232,"statfs":{"total":386547056640,"available":386281709568,"internally_reserved":0,"allocated":14725120,"data_stored":7210725,"data_compressed":354490,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":250544128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003291"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504619+0000","last_change":"2024-09-11T14:16:01.478105+0000","last_active":"2024-09-11T14:29:55.504619+0000","last_peered":"2024-09-11T14:29:55.504619+0000","last_clean":"2024-09-11T14:29:55.504619+0000","last_became_active":"2024-09-11T14:16:01.469796+0000","last_became_peered":"2024-09-11T14:16:01.469796+0000","last_unstale":"2024-09-11T14:29:55.504619+0000","last_undegraded":"2024-09-11T14:29:55.504619+0000","last_fullsized":"2024-09-11T14:29:55.504619+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.505673+0000","last_change":"2024-09-11T14:16:01.566671+0000","last_active":"2024-09-11T14:29:55.505673+0000","last_peered":"2024-09-11T14:29:55.505673+0000","last_clean":"2024-09-11T14:29:55.505673+0000","last_became_active":"2024-09-11T14:16:01.553483+0000","last_became_peered":"2024-09-11T14:16:01.553483+0000","last_unstale":"2024-09-11T14:29:55.505673+0000","last_undegraded":"2024-09-11T14:29:55.505673+0000","last_fullsized":"2024-09-11T14:29:55.505673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.500570+0000","last_change":"2024-09-11T14:16:01.491814+0000","last_active":"2024-09-11T14:29:55.500570+0000","last_peered":"2024-09-11T14:29:55.500570+0000","last_clean":"2024-09-11T14:29:55.500570+0000","last_became_active":"2024-09-11T14:16:01.485851+0000","last_became_peered":"2024-09-11T14:16:01.485851+0000","last_unstale":"2024-09-11T14:29:55.500570+0000","last_undegraded":"2024-09-11T14:29:55.500570+0000","last_fullsized":"2024-09-11T14:29:55.500570+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.488003+0000","last_change":"2024-09-11T14:16:01.497743+0000","last_active":"2024-09-11T14:29:55.488003+0000","last_peered":"2024-09-11T14:29:55.488003+0000","last_clean":"2024-09-11T14:29:55.488003+0000","last_became_active":"2024-09-11T14:16:01.469079+0000","last_became_peered":"2024-09-11T14:16:01.469079+0000","last_unstale":"2024-09-11T14:29:55.488003+0000","last_undegraded":"2024-09-11T14:29:55.488003+0000","last_fullsized":"2024-09-11T14:29:55.488003+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489764+0000","last_change":"2024-09-11T14:16:01.492881+0000","last_active":"2024-09-11T14:29:55.489764+0000","last_peered":"2024-09-11T14:29:55.489764+0000","last_clean":"2024-09-11T14:29:55.489764+0000","last_became_active":"2024-09-11T14:16:01.480473+0000","last_became_peered":"2024-09-11T14:16:01.480473+0000","last_unstale":"2024-09-11T14:29:55.489764+0000","last_undegraded":"2024-09-11T14:29:55.489764+0000","last_fullsized":"2024-09-11T14:29:55.489764+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.490446+0000","last_change":"2024-09-11T14:16:01.541899+0000","last_active":"2024-09-11T14:29:55.490446+0000","last_peered":"2024-09-11T14:29:55.490446+0000","last_clean":"2024-09-11T14:29:55.490446+0000","last_became_active":"2024-09-11T14:16:01.515259+0000","last_became_peered":"2024-09-11T14:16:01.515259+0000","last_unstale":"2024-09-11T14:29:55.490446+0000","last_undegraded":"2024-09-11T14:29:55.490446+0000","last_fullsized":"2024-09-11T14:29:55.490446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515043+0000","last_change":"2024-09-11T14:16:01.523684+0000","last_active":"2024-09-11T14:29:55.515043+0000","last_peered":"2024-09-11T14:29:55.515043+0000","last_clean":"2024-09-11T14:29:55.515043+0000","last_became_active":"2024-09-11T14:16:01.510524+0000","last_became_peered":"2024-09-11T14:16:01.510524+0000","last_unstale":"2024-09-11T14:29:55.515043+0000","last_undegraded":"2024-09-11T14:29:55.515043+0000","last_fullsized":"2024-09-11T14:29:55.515043+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523629+0000","last_change":"2024-09-11T14:16:01.525329+0000","last_active":"2024-09-11T14:29:55.523629+0000","last_peered":"2024-09-11T14:29:55.523629+0000","last_clean":"2024-09-11T14:29:55.523629+0000","last_became_active":"2024-09-11T14:16:01.514773+0000","last_became_peered":"2024-09-11T14:16:01.514773+0000","last_unstale":"2024-09-11T14:29:55.523629+0000","last_undegraded":"2024-09-11T14:29:55.523629+0000","last_fullsized":"2024-09-11T14:29:55.523629+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.498084+0000","last_change":"2024-09-11T14:16:01.533436+0000","last_active":"2024-09-11T14:29:55.498084+0000","last_peered":"2024-09-11T14:29:55.498084+0000","last_clean":"2024-09-11T14:29:55.498084+0000","last_became_active":"2024-09-11T14:16:01.525822+0000","last_became_peered":"2024-09-11T14:16:01.525822+0000","last_unstale":"2024-09-11T14:29:55.498084+0000","last_undegraded":"2024-09-11T14:29:55.498084+0000","last_fullsized":"2024-09-11T14:29:55.498084+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.487709+0000","last_change":"2024-09-11T14:16:01.514314+0000","last_active":"2024-09-11T14:29:55.487709+0000","last_peered":"2024-09-11T14:29:55.487709+0000","last_clean":"2024-09-11T14:29:55.487709+0000","last_became_active":"2024-09-11T14:16:01.499412+0000","last_became_peered":"2024-09-11T14:16:01.499412+0000","last_unstale":"2024-09-11T14:29:55.487709+0000","last_undegraded":"2024-09-11T14:29:55.487709+0000","last_fullsized":"2024-09-11T14:29:55.487709+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.507704+0000","last_change":"2024-09-11T14:16:01.517824+0000","last_active":"2024-09-11T14:29:55.507704+0000","last_peered":"2024-09-11T14:29:55.507704+0000","last_clean":"2024-09-11T14:29:55.507704+0000","last_became_active":"2024-09-11T14:16:01.507489+0000","last_became_peered":"2024-09-11T14:16:01.507489+0000","last_unstale":"2024-09-11T14:29:55.507704+0000","last_undegraded":"2024-09-11T14:29:55.507704+0000","last_fullsized":"2024-09-11T14:29:55.507704+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523786+0000","last_change":"2024-09-11T14:16:01.572297+0000","last_active":"2024-09-11T14:29:55.523786+0000","last_peered":"2024-09-11T14:29:55.523786+0000","last_clean":"2024-09-11T14:29:55.523786+0000","last_became_active":"2024-09-11T14:16:01.564983+0000","last_became_peered":"2024-09-11T14:16:01.564983+0000","last_unstale":"2024-09-11T14:29:55.523786+0000","last_undegraded":"2024-09-11T14:29:55.523786+0000","last_fullsized":"2024-09-11T14:29:55.523786+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.492434+0000","last_change":"2024-09-11T14:16:01.553374+0000","last_active":"2024-09-11T14:29:55.492434+0000","last_peered":"2024-09-11T14:29:55.492434+0000","last_clean":"2024-09-11T14:29:55.492434+0000","last_became_active":"2024-09-11T14:16:01.546695+0000","last_became_peered":"2024-09-11T14:16:01.546695+0000","last_unstale":"2024-09-11T14:29:55.492434+0000","last_undegraded":"2024-09-11T14:29:55.492434+0000","last_fullsized":"2024-09-11T14:29:55.492434+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.494645+0000","last_change":"2024-09-11T14:16:01.549306+0000","last_active":"2024-09-11T14:29:55.494645+0000","last_peered":"2024-09-11T14:29:55.494645+0000","last_clean":"2024-09-11T14:29:55.494645+0000","last_became_active":"2024-09-11T14:16:01.541719+0000","last_became_peered":"2024-09-11T14:16:01.541719+0000","last_unstale":"2024-09-11T14:29:55.494645+0000","last_undegraded":"2024-09-11T14:29:55.494645+0000","last_fullsized":"2024-09-11T14:29:55.494645+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511367+0000","last_change":"2024-09-11T14:16:01.609878+0000","last_active":"2024-09-11T14:29:55.511367+0000","last_peered":"2024-09-11T14:29:55.511367+0000","last_clean":"2024-09-11T14:29:55.511367+0000","last_became_active":"2024-09-11T14:16:01.598547+0000","last_became_peered":"2024-09-11T14:16:01.598547+0000","last_unstale":"2024-09-11T14:29:55.511367+0000","last_undegraded":"2024-09-11T14:29:55.511367+0000","last_fullsized":"2024-09-11T14:29:55.511367+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.493382+0000","last_change":"2024-09-11T14:16:01.555603+0000","last_active":"2024-09-11T14:29:55.493382+0000","last_peered":"2024-09-11T14:29:55.493382+0000","last_clean":"2024-09-11T14:29:55.493382+0000","last_became_active":"2024-09-11T14:16:01.528427+0000","last_became_peered":"2024-09-11T14:16:01.528427+0000","last_unstale":"2024-09-11T14:29:55.493382+0000","last_undegraded":"2024-09-11T14:29:55.493382+0000","last_fullsized":"2024-09-11T14:29:55.493382+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.532842+0000","last_change":"2024-09-11T14:16:01.556304+0000","last_active":"2024-09-11T14:29:55.532842+0000","last_peered":"2024-09-11T14:29:55.532842+0000","last_clean":"2024-09-11T14:29:55.532842+0000","last_became_active":"2024-09-11T14:16:01.540687+0000","last_became_peered":"2024-09-11T14:16:01.540687+0000","last_unstale":"2024-09-11T14:29:55.532842+0000","last_undegraded":"2024-09-11T14:29:55.532842+0000","last_fullsized":"2024-09-11T14:29:55.532842+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497272+0000","last_change":"2024-09-11T14:16:01.494968+0000","last_active":"2024-09-11T14:29:55.497272+0000","last_peered":"2024-09-11T14:29:55.497272+0000","last_clean":"2024-09-11T14:29:55.497272+0000","last_became_active":"2024-09-11T14:16:01.475901+0000","last_became_peered":"2024-09-11T14:16:01.475901+0000","last_unstale":"2024-09-11T14:29:55.497272+0000","last_undegraded":"2024-09-11T14:29:55.497272+0000","last_fullsized":"2024-09-11T14:29:55.497272+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.504034+0000","last_change":"2024-09-11T14:16:01.496009+0000","last_active":"2024-09-11T14:29:55.504034+0000","last_peered":"2024-09-11T14:29:55.504034+0000","last_clean":"2024-09-11T14:29:55.504034+0000","last_became_active":"2024-09-11T14:16:01.485861+0000","last_became_peered":"2024-09-11T14:16:01.485861+0000","last_unstale":"2024-09-11T14:29:55.504034+0000","last_undegraded":"2024-09-11T14:29:55.504034+0000","last_fullsized":"2024-09-11T14:29:55.504034+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503865+0000","last_change":"2024-09-11T14:16:01.511330+0000","last_active":"2024-09-11T14:29:55.503865+0000","last_peered":"2024-09-11T14:29:55.503865+0000","last_clean":"2024-09-11T14:29:55.503865+0000","last_became_active":"2024-09-11T14:16:01.497752+0000","last_became_peered":"2024-09-11T14:16:01.497752+0000","last_unstale":"2024-09-11T14:29:55.503865+0000","last_undegraded":"2024-09-11T14:29:55.503865+0000","last_fullsized":"2024-09-11T14:29:55.503865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.503010+0000","last_change":"2024-09-11T14:16:01.548238+0000","last_active":"2024-09-11T14:29:55.503010+0000","last_peered":"2024-09-11T14:29:55.503010+0000","last_clean":"2024-09-11T14:29:55.503010+0000","last_became_active":"2024-09-11T14:16:01.540272+0000","last_became_peered":"2024-09-11T14:16:01.540272+0000","last_unstale":"2024-09-11T14:29:55.503010+0000","last_undegraded":"2024-09-11T14:29:55.503010+0000","last_fullsized":"2024-09-11T14:29:55.503010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491594+0000","last_change":"2024-09-11T14:16:01.530012+0000","last_active":"2024-09-11T14:29:55.491594+0000","last_peered":"2024-09-11T14:29:55.491594+0000","last_clean":"2024-09-11T14:29:55.491594+0000","last_became_active":"2024-09-11T14:16:01.516906+0000","last_became_peered":"2024-09-11T14:16:01.516906+0000","last_unstale":"2024-09-11T14:29:55.491594+0000","last_undegraded":"2024-09-11T14:29:55.491594+0000","last_fullsized":"2024-09-11T14:29:55.491594+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.501848+0000","last_change":"2024-09-11T14:16:01.535163+0000","last_active":"2024-09-11T14:29:55.501848+0000","last_peered":"2024-09-11T14:29:55.501848+0000","last_clean":"2024-09-11T14:29:55.501848+0000","last_became_active":"2024-09-11T14:16:01.524168+0000","last_became_peered":"2024-09-11T14:16:01.524168+0000","last_unstale":"2024-09-11T14:29:55.501848+0000","last_undegraded":"2024-09-11T14:29:55.501848+0000","last_fullsized":"2024-09-11T14:29:55.501848+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.520363+0000","last_change":"2024-09-11T14:16:01.525020+0000","last_active":"2024-09-11T14:29:55.520363+0000","last_peered":"2024-09-11T14:29:55.520363+0000","last_clean":"2024-09-11T14:29:55.520363+0000","last_became_active":"2024-09-11T14:16:01.519043+0000","last_became_peered":"2024-09-11T14:16:01.519043+0000","last_unstale":"2024-09-11T14:29:55.520363+0000","last_undegraded":"2024-09-11T14:29:55.520363+0000","last_fullsized":"2024-09-11T14:29:55.520363+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511420+0000","last_change":"2024-09-11T14:16:01.514997+0000","last_active":"2024-09-11T14:29:55.511420+0000","last_peered":"2024-09-11T14:29:55.511420+0000","last_clean":"2024-09-11T14:29:55.511420+0000","last_became_active":"2024-09-11T14:16:01.508423+0000","last_became_peered":"2024-09-11T14:16:01.508423+0000","last_unstale":"2024-09-11T14:29:55.511420+0000","last_undegraded":"2024-09-11T14:29:55.511420+0000","last_fullsized":"2024-09-11T14:29:55.511420+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.523289+0000","last_change":"2024-09-11T14:16:01.528298+0000","last_active":"2024-09-11T14:29:55.523289+0000","last_peered":"2024-09-11T14:29:55.523289+0000","last_clean":"2024-09-11T14:29:55.523289+0000","last_became_active":"2024-09-11T14:16:01.505280+0000","last_became_peered":"2024-09-11T14:16:01.505280+0000","last_unstale":"2024-09-11T14:29:55.523289+0000","last_undegraded":"2024-09-11T14:29:55.523289+0000","last_fullsized":"2024-09-11T14:29:55.523289+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.511025+0000","last_change":"2024-09-11T14:16:01.582504+0000","last_active":"2024-09-11T14:29:55.511025+0000","last_peered":"2024-09-11T14:29:55.511025+0000","last_clean":"2024-09-11T14:29:55.511025+0000","last_became_active":"2024-09-11T14:16:01.573403+0000","last_became_peered":"2024-09-11T14:16:01.573403+0000","last_unstale":"2024-09-11T14:29:55.511025+0000","last_undegraded":"2024-09-11T14:29:55.511025+0000","last_fullsized":"2024-09-11T14:29:55.511025+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.525031+0000","last_change":"2024-09-11T14:16:01.614988+0000","last_active":"2024-09-11T14:29:55.525031+0000","last_peered":"2024-09-11T14:29:55.525031+0000","last_clean":"2024-09-11T14:29:55.525031+0000","last_became_active":"2024-09-11T14:16:01.607437+0000","last_became_peered":"2024-09-11T14:16:01.607437+0000","last_unstale":"2024-09-11T14:29:55.525031+0000","last_undegraded":"2024-09-11T14:29:55.525031+0000","last_fullsized":"2024-09-11T14:29:55.525031+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.517913+0000","last_change":"2024-09-11T14:16:01.537504+0000","last_active":"2024-09-11T14:29:55.517913+0000","last_peered":"2024-09-11T14:29:55.517913+0000","last_clean":"2024-09-11T14:29:55.517913+0000","last_became_active":"2024-09-11T14:16:01.520713+0000","last_became_peered":"2024-09-11T14:16:01.520713+0000","last_unstale":"2024-09-11T14:29:55.517913+0000","last_undegraded":"2024-09-11T14:29:55.517913+0000","last_fullsized":"2024-09-11T14:29:55.517913+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.509228+0000","last_change":"2024-09-11T14:16:01.486527+0000","last_active":"2024-09-11T14:29:55.509228+0000","last_peered":"2024-09-11T14:29:55.509228+0000","last_clean":"2024-09-11T14:29:55.509228+0000","last_became_active":"2024-09-11T14:16:01.470273+0000","last_became_peered":"2024-09-11T14:16:01.470273+0000","last_unstale":"2024-09-11T14:29:55.509228+0000","last_undegraded":"2024-09-11T14:29:55.509228+0000","last_fullsized":"2024-09-11T14:29:55.509228+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1467,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.515484+0000","last_change":"2024-09-11T14:16:01.518850+0000","last_active":"2024-09-11T14:29:55.515484+0000","last_peered":"2024-09-11T14:29:55.515484+0000","last_clean":"2024-09-11T14:29:55.515484+0000","last_became_active":"2024-09-11T14:16:01.504043+0000","last_became_peered":"2024-09-11T14:16:01.504043+0000","last_unstale":"2024-09-11T14:29:55.515484+0000","last_undegraded":"2024-09-11T14:29:55.515484+0000","last_fullsized":"2024-09-11T14:29:55.515484+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1454,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.502154+0000","last_change":"2024-09-11T14:16:01.490663+0000","last_active":"2024-09-11T14:29:55.502154+0000","last_peered":"2024-09-11T14:29:55.502154+0000","last_clean":"2024-09-11T14:29:55.502154+0000","last_became_active":"2024-09-11T14:16:01.479206+0000","last_became_peered":"2024-09-11T14:16:01.479206+0000","last_unstale":"2024-09-11T14:29:55.502154+0000","last_undegraded":"2024-09-11T14:29:55.502154+0000","last_fullsized":"2024-09-11T14:29:55.502154+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:16:00.357279+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506288+0000","last_change":"2024-09-11T14:11:01.590400+0000","last_active":"2024-09-11T14:29:55.506288+0000","last_peered":"2024-09-11T14:29:55.506288+0000","last_clean":"2024-09-11T14:29:55.506288+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:29:55.506288+0000","last_undegraded":"2024-09-11T14:29:55.506288+0000","last_fullsized":"2024-09-11T14:29:55.506288+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.491586+0000","last_change":"2024-09-11T14:11:01.587732+0000","last_active":"2024-09-11T14:29:55.491586+0000","last_peered":"2024-09-11T14:29:55.491586+0000","last_clean":"2024-09-11T14:29:55.491586+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:29:55.491586+0000","last_undegraded":"2024-09-11T14:29:55.491586+0000","last_fullsized":"2024-09-11T14:29:55.491586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506562+0000","last_change":"2024-09-11T14:11:01.587844+0000","last_active":"2024-09-11T14:29:55.506562+0000","last_peered":"2024-09-11T14:29:55.506562+0000","last_clean":"2024-09-11T14:29:55.506562+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:29:55.506562+0000","last_undegraded":"2024-09-11T14:29:55.506562+0000","last_fullsized":"2024-09-11T14:29:55.506562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489183+0000","last_change":"2024-09-11T14:11:01.585502+0000","last_active":"2024-09-11T14:29:55.489183+0000","last_peered":"2024-09-11T14:29:55.489183+0000","last_clean":"2024-09-11T14:29:55.489183+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:29:55.489183+0000","last_undegraded":"2024-09-11T14:29:55.489183+0000","last_fullsized":"2024-09-11T14:29:55.489183+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":2132,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.516852+0000","last_change":"2024-09-11T14:11:01.588321+0000","last_active":"2024-09-11T14:29:55.516852+0000","last_peered":"2024-09-11T14:29:55.516852+0000","last_clean":"2024-09-11T14:29:55.516852+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:29:55.516852+0000","last_undegraded":"2024-09-11T14:29:55.516852+0000","last_fullsized":"2024-09-11T14:29:55.516852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.497120+0000","last_change":"2024-09-11T14:11:01.587060+0000","last_active":"2024-09-11T14:29:55.497120+0000","last_peered":"2024-09-11T14:29:55.497120+0000","last_clean":"2024-09-11T14:29:55.497120+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:29:55.497120+0000","last_undegraded":"2024-09-11T14:29:55.497120+0000","last_fullsized":"2024-09-11T14:29:55.497120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2130,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.536047+0000","last_change":"2024-09-11T14:11:01.589239+0000","last_active":"2024-09-11T14:29:55.536047+0000","last_peered":"2024-09-11T14:29:55.536047+0000","last_clean":"2024-09-11T14:29:55.536047+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:29:55.536047+0000","last_undegraded":"2024-09-11T14:29:55.536047+0000","last_fullsized":"2024-09-11T14:29:55.536047+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":2131,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.506831+0000","last_change":"2024-09-11T14:11:01.590912+0000","last_active":"2024-09-11T14:29:55.506831+0000","last_peered":"2024-09-11T14:29:55.506831+0000","last_clean":"2024-09-11T14:29:55.506831+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:29:55.506831+0000","last_undegraded":"2024-09-11T14:29:55.506831+0000","last_fullsized":"2024-09-11T14:29:55.506831+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:58.550701+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2199,"reported_epoch":719,"state":"active+clean","last_fresh":"2024-09-11T14:29:55.489882+0000","last_change":"2024-09-11T14:10:58.605266+0000","last_active":"2024-09-11T14:29:55.489882+0000","last_peered":"2024-09-11T14:29:55.489882+0000","last_clean":"2024-09-11T14:29:55.489882+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:29:55.489882+0000","last_undegraded":"2024-09-11T14:29:55.489882+0000","last_fullsized":"2024-09-11T14:29:55.489882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:10:57.546724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70724,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301116,"statfs":{"total":96636764160,"available":96564342784,"internally_reserved":0,"allocated":3710976,"data_stored":2103141,"data_compressed":106589,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66488,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305352,"statfs":{"total":96636764160,"available":96568680448,"internally_reserved":0,"allocated":3645440,"data_stored":1500020,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60904,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310936,"statfs":{"total":96636764160,"available":96574398464,"internally_reserved":0,"allocated":3629056,"data_stored":1487224,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61012,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310828,"statfs":{"total":96636764160,"available":96574287872,"internally_reserved":0,"allocated":3739648,"data_stored":2120340,"data_compressed":112477,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:30:21.986 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.986 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.986 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.986 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.986 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.986 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.987 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.988 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.989 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-11T14:16:00.357279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=16, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T14:10:58.550701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.990 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T14:10:57.546724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=10, tm_sec=57, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=29, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:30:21.991 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T14:30:41.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:30:42.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.107+0000 7f9f2ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:42.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.112+0000 7f9f2ed91640 1 Processor -- start 2024-09-11T14:30:42.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.112+0000 7f9f2ed91640 1 -- start start 2024-09-11T14:30:42.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.113+0000 7f9f2ed91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9f2812f730 0x7f9f2812fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:42.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.113+0000 7f9f2ed91640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2809ddb0 con 0x7f9f28130080 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.113+0000 7f9f2ed91640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2809dfe0 con 0x7f9f2812f730 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.113+0000 7f9f2cb2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9f2812f730 0x7f9f2812fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.113+0000 7f9f2cb2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9f2812f730 0x7f9f2812fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41532/0 (socket says 172.21.15.97:41532) 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.113+0000 7f9f27fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9f28130080 0x7f9f2809c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45966/0 (socket says 172.21.15.97:45966) 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.113+0000 7f9f2cb2d640 1 -- 172.21.15.97:0/1272070578 learned_addr learned my addr 172.21.15.97:0/1272070578 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.114+0000 7f9f2cb2d640 1 -- 172.21.15.97:0/1272070578 >> v1:172.21.15.97:6789/0 conn(0x7f9f28130080 legacy=0x7f9f2809c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.114+0000 7f9f2cb2d640 1 -- 172.21.15.97:0/1272070578 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f28098180 con 0x7f9f2812f730 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.114+0000 7f9f2cb2d640 1 --2- 172.21.15.97:0/1272070578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2812fb40 crc :-1 s=READY pgs=13041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f177a1a8080798 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.114+0000 7f9f277fe640 1 -- 172.21.15.97:0/1272070578 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f18009e50 con 0x7f9f2812f730 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.114+0000 7f9f277fe640 1 -- 172.21.15.97:0/1272070578 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9f1800e230 con 0x7f9f2812f730 2024-09-11T14:30:42.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.114+0000 7f9f277fe640 1 -- 172.21.15.97:0/1272070578 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f1800e4d0 con 0x7f9f2812f730 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 1 -- 172.21.15.97:0/1272070578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 msgr2=0x7f9f2812fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 1 --2- 172.21.15.97:0/1272070578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2812fb40 crc :-1 s=READY pgs=13041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 1 -- 172.21.15.97:0/1272070578 shutdown_connections 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 1 --2- 172.21.15.97:0/1272070578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2812fb40 unknown :-1 s=CLOSED pgs=13041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 1 -- 172.21.15.97:0/1272070578 >> 172.21.15.97:0/1272070578 conn(0x7f9f280a11f0 msgr2=0x7f9f280a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 1 -- 172.21.15.97:0/1272070578 shutdown_connections 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 1 -- 172.21.15.97:0/1272070578 wait complete. 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.115+0000 7f9f2ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.116+0000 7f9f2ed91640 1 Processor -- start 2024-09-11T14:30:42.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.116+0000 7f9f2ed91640 1 -- start start 2024-09-11T14:30:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2ed91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2ed91640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28072490 con 0x7f9f2812f730 2024-09-11T14:30:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2cb2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2cb2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2806efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41548/0 (socket says 172.21.15.97:41548) 2024-09-11T14:30:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2cb2d640 1 -- 172.21.15.97:0/2981692841 learned_addr learned my addr 172.21.15.97:0/2981692841 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2cb2d640 1 -- 172.21.15.97:0/2981692841 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2809a660 con 0x7f9f2812f730 2024-09-11T14:30:42.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2cb2d640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2806efd0 crc :-1 s=READY pgs=13042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f257fa640 1 -- 172.21.15.97:0/2981692841 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f1800eda0 con 0x7f9f2812f730 2024-09-11T14:30:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f257fa640 1 -- 172.21.15.97:0/2981692841 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9f18015420 con 0x7f9f2812f730 2024-09-11T14:30:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f28071860 con 0x7f9f2812f730 2024-09-11T14:30:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f257fa640 1 -- 172.21.15.97:0/2981692841 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f180156c0 con 0x7f9f2812f730 2024-09-11T14:30:42.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.118+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2812ccb0 con 0x7f9f2812f730 2024-09-11T14:30:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.119+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2812fb40 con 0x7f9f2812f730 2024-09-11T14:30:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.119+0000 7f9f257fa640 1 -- 172.21.15.97:0/2981692841 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9f180158c0 con 0x7f9f2812f730 2024-09-11T14:30:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.120+0000 7f9f257fa640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9f1403e8e0 0x7f9f14040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.120+0000 7f9f257fa640 1 -- 172.21.15.97:0/2981692841 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f9f18050f90 con 0x7f9f2812f730 2024-09-11T14:30:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.120+0000 7f9f27fff640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9f1403e8e0 0x7f9f14040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:42.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.120+0000 7f9f27fff640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9f1403e8e0 0x7f9f14040df0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:42.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.125+0000 7f9f257fa640 1 -- 172.21.15.97:0/2981692841 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f9f18014c10 con 0x7f9f2812f730 2024-09-11T14:30:42.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.297+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 --> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f280716f0 con 0x7f9f1403e8e0 2024-09-11T14:30:42.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.300+0000 7f9f257fa640 1 -- 172.21.15.97:0/2981692841 <== mgr.4100 v2:172.21.15.117:6800/3188360781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109197 (crc 0 0 0) 0x7f9f280716f0 con 0x7f9f1403e8e0 2024-09-11T14:30:42.302 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-11T14:30:42.303 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-11T14:30:42.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.302+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9f1403e8e0 msgr2=0x7f9f14040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.302+0000 7f9f2ed91640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9f1403e8e0 0x7f9f14040df0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.302+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 msgr2=0x7f9f2806efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.302+0000 7f9f2ed91640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2806efd0 crc :-1 s=READY pgs=13042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.302+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 shutdown_connections 2024-09-11T14:30:42.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.302+0000 7f9f2ed91640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f9f1403e8e0 0x7f9f14040df0 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.302+0000 7f9f2ed91640 1 --2- 172.21.15.97:0/2981692841 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9f2812f730 0x7f9f2806efd0 unknown :-1 s=CLOSED pgs=13042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.303+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 >> 172.21.15.97:0/2981692841 conn(0x7f9f280a11f0 msgr2=0x7f9f2812de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:42.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.303+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 shutdown_connections 2024-09-11T14:30:42.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.303+0000 7f9f2ed91640 1 -- 172.21.15.97:0/2981692841 wait complete. 2024-09-11T14:30:42.315 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1305,"stamp":"2024-09-11T14:30:40.810039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266920,"kb_used_data":13864,"kb_used_omap":0,"kb_used_meta":252992,"kb_avail":377220440,"statfs":{"total":386547056640,"available":386273730560,"internally_reserved":0,"allocated":14196736,"data_stored":6601144,"data_compressed":60090,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":259063808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003252"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.363670+0000","last_change":"2024-09-11T14:30:00.385286+0000","last_active":"2024-09-11T14:30:00.363670+0000","last_peered":"2024-09-11T14:30:00.363670+0000","last_clean":"2024-09-11T14:30:00.363670+0000","last_became_active":"2024-09-11T14:16:01.469796+0000","last_became_peered":"2024-09-11T14:16:01.469796+0000","last_unstale":"2024-09-11T14:30:00.363670+0000","last_undegraded":"2024-09-11T14:30:00.363670+0000","last_fullsized":"2024-09-11T14:30:00.363670+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.385008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.385008+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.900523+0000","last_change":"2024-09-11T14:29:59.916997+0000","last_active":"2024-09-11T14:29:59.900523+0000","last_peered":"2024-09-11T14:29:59.900523+0000","last_clean":"2024-09-11T14:29:59.900523+0000","last_became_active":"2024-09-11T14:16:01.553483+0000","last_became_peered":"2024-09-11T14:16:01.553483+0000","last_unstale":"2024-09-11T14:29:59.900523+0000","last_undegraded":"2024-09-11T14:29:59.900523+0000","last_fullsized":"2024-09-11T14:29:59.900523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.916820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.916820+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.831635+0000","last_change":"2024-09-11T14:30:00.849657+0000","last_active":"2024-09-11T14:30:00.831635+0000","last_peered":"2024-09-11T14:30:00.831635+0000","last_clean":"2024-09-11T14:30:00.831635+0000","last_became_active":"2024-09-11T14:16:01.485851+0000","last_became_peered":"2024-09-11T14:16:01.485851+0000","last_unstale":"2024-09-11T14:30:00.831635+0000","last_undegraded":"2024-09-11T14:30:00.831635+0000","last_fullsized":"2024-09-11T14:30:00.831635+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.849487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.849487+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.302581+0000","last_change":"2024-09-11T14:30:01.330461+0000","last_active":"2024-09-11T14:30:01.302581+0000","last_peered":"2024-09-11T14:30:01.302581+0000","last_clean":"2024-09-11T14:30:01.302581+0000","last_became_active":"2024-09-11T14:16:01.469079+0000","last_became_peered":"2024-09-11T14:16:01.469079+0000","last_unstale":"2024-09-11T14:30:01.302581+0000","last_undegraded":"2024-09-11T14:30:01.302581+0000","last_fullsized":"2024-09-11T14:30:01.302581+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.330283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.330283+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.362365+0000","last_change":"2024-09-11T14:30:00.387179+0000","last_active":"2024-09-11T14:30:00.362365+0000","last_peered":"2024-09-11T14:30:00.362365+0000","last_clean":"2024-09-11T14:30:00.362365+0000","last_became_active":"2024-09-11T14:16:01.480473+0000","last_became_peered":"2024-09-11T14:16:01.480473+0000","last_unstale":"2024-09-11T14:30:00.362365+0000","last_undegraded":"2024-09-11T14:30:00.362365+0000","last_fullsized":"2024-09-11T14:30:00.362365+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.387011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.387011+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.898990+0000","last_change":"2024-09-11T14:29:59.914203+0000","last_active":"2024-09-11T14:29:59.898990+0000","last_peered":"2024-09-11T14:29:59.898990+0000","last_clean":"2024-09-11T14:29:59.898990+0000","last_became_active":"2024-09-11T14:16:01.515259+0000","last_became_peered":"2024-09-11T14:16:01.515259+0000","last_unstale":"2024-09-11T14:29:59.898990+0000","last_undegraded":"2024-09-11T14:29:59.898990+0000","last_fullsized":"2024-09-11T14:29:59.898990+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.914038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.914038+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.897871+0000","last_change":"2024-09-11T14:29:59.914165+0000","last_active":"2024-09-11T14:29:59.897871+0000","last_peered":"2024-09-11T14:29:59.897871+0000","last_clean":"2024-09-11T14:29:59.897871+0000","last_became_active":"2024-09-11T14:16:01.510524+0000","last_became_peered":"2024-09-11T14:16:01.510524+0000","last_unstale":"2024-09-11T14:29:59.897871+0000","last_undegraded":"2024-09-11T14:29:59.897871+0000","last_fullsized":"2024-09-11T14:29:59.897871+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.913958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.913958+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.895203+0000","last_change":"2024-09-11T14:29:59.912239+0000","last_active":"2024-09-11T14:29:59.895203+0000","last_peered":"2024-09-11T14:29:59.895203+0000","last_clean":"2024-09-11T14:29:59.895203+0000","last_became_active":"2024-09-11T14:16:01.514773+0000","last_became_peered":"2024-09-11T14:16:01.514773+0000","last_unstale":"2024-09-11T14:29:59.895203+0000","last_undegraded":"2024-09-11T14:29:59.895203+0000","last_fullsized":"2024-09-11T14:29:59.895203+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.912019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.912019+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.297952+0000","last_change":"2024-09-11T14:30:01.332132+0000","last_active":"2024-09-11T14:30:01.297952+0000","last_peered":"2024-09-11T14:30:01.297952+0000","last_clean":"2024-09-11T14:30:01.297952+0000","last_became_active":"2024-09-11T14:16:01.525822+0000","last_became_peered":"2024-09-11T14:16:01.525822+0000","last_unstale":"2024-09-11T14:30:01.297952+0000","last_undegraded":"2024-09-11T14:30:01.297952+0000","last_fullsized":"2024-09-11T14:30:01.297952+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.331926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.331926+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.830104+0000","last_change":"2024-09-11T14:30:00.846414+0000","last_active":"2024-09-11T14:30:00.830104+0000","last_peered":"2024-09-11T14:30:00.830104+0000","last_clean":"2024-09-11T14:30:00.830104+0000","last_became_active":"2024-09-11T14:16:01.499412+0000","last_became_peered":"2024-09-11T14:16:01.499412+0000","last_unstale":"2024-09-11T14:30:00.830104+0000","last_undegraded":"2024-09-11T14:30:00.830104+0000","last_fullsized":"2024-09-11T14:30:00.830104+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.846228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.846228+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.296529+0000","last_change":"2024-09-11T14:30:01.324329+0000","last_active":"2024-09-11T14:30:01.296529+0000","last_peered":"2024-09-11T14:30:01.296529+0000","last_clean":"2024-09-11T14:30:01.296529+0000","last_became_active":"2024-09-11T14:16:01.507489+0000","last_became_peered":"2024-09-11T14:16:01.507489+0000","last_unstale":"2024-09-11T14:30:01.296529+0000","last_undegraded":"2024-09-11T14:30:01.296529+0000","last_fullsized":"2024-09-11T14:30:01.296529+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.324150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.324150+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.895533+0000","last_change":"2024-09-11T14:29:59.916134+0000","last_active":"2024-09-11T14:29:59.895533+0000","last_peered":"2024-09-11T14:29:59.895533+0000","last_clean":"2024-09-11T14:29:59.895533+0000","last_became_active":"2024-09-11T14:16:01.564983+0000","last_became_peered":"2024-09-11T14:16:01.564983+0000","last_unstale":"2024-09-11T14:29:59.895533+0000","last_undegraded":"2024-09-11T14:29:59.895533+0000","last_fullsized":"2024-09-11T14:29:59.895533+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.915973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.915973+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.294038+0000","last_change":"2024-09-11T14:30:01.318000+0000","last_active":"2024-09-11T14:30:01.294038+0000","last_peered":"2024-09-11T14:30:01.294038+0000","last_clean":"2024-09-11T14:30:01.294038+0000","last_became_active":"2024-09-11T14:16:01.546695+0000","last_became_peered":"2024-09-11T14:16:01.546695+0000","last_unstale":"2024-09-11T14:30:01.294038+0000","last_undegraded":"2024-09-11T14:30:01.294038+0000","last_fullsized":"2024-09-11T14:30:01.294038+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.317657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.317657+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.294001+0000","last_change":"2024-09-11T14:30:01.325296+0000","last_active":"2024-09-11T14:30:01.294001+0000","last_peered":"2024-09-11T14:30:01.294001+0000","last_clean":"2024-09-11T14:30:01.294001+0000","last_became_active":"2024-09-11T14:16:01.541719+0000","last_became_peered":"2024-09-11T14:16:01.541719+0000","last_unstale":"2024-09-11T14:30:01.294001+0000","last_undegraded":"2024-09-11T14:30:01.294001+0000","last_fullsized":"2024-09-11T14:30:01.294001+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.325104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.325104+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.891809+0000","last_change":"2024-09-11T14:29:59.910307+0000","last_active":"2024-09-11T14:29:59.891809+0000","last_peered":"2024-09-11T14:29:59.891809+0000","last_clean":"2024-09-11T14:29:59.891809+0000","last_became_active":"2024-09-11T14:16:01.598547+0000","last_became_peered":"2024-09-11T14:16:01.598547+0000","last_unstale":"2024-09-11T14:29:59.891809+0000","last_undegraded":"2024-09-11T14:29:59.891809+0000","last_fullsized":"2024-09-11T14:29:59.891809+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.910043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.910043+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.890612+0000","last_change":"2024-09-11T14:29:59.913223+0000","last_active":"2024-09-11T14:29:59.890612+0000","last_peered":"2024-09-11T14:29:59.890612+0000","last_clean":"2024-09-11T14:29:59.890612+0000","last_became_active":"2024-09-11T14:16:01.528427+0000","last_became_peered":"2024-09-11T14:16:01.528427+0000","last_unstale":"2024-09-11T14:29:59.890612+0000","last_undegraded":"2024-09-11T14:29:59.890612+0000","last_fullsized":"2024-09-11T14:29:59.890612+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.912920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.912920+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.891636+0000","last_change":"2024-09-11T14:29:59.916028+0000","last_active":"2024-09-11T14:29:59.891636+0000","last_peered":"2024-09-11T14:29:59.891636+0000","last_clean":"2024-09-11T14:29:59.891636+0000","last_became_active":"2024-09-11T14:16:01.540687+0000","last_became_peered":"2024-09-11T14:16:01.540687+0000","last_unstale":"2024-09-11T14:29:59.891636+0000","last_undegraded":"2024-09-11T14:29:59.891636+0000","last_fullsized":"2024-09-11T14:29:59.891636+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.915855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.915855+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.289026+0000","last_change":"2024-09-11T14:30:01.318828+0000","last_active":"2024-09-11T14:30:01.289026+0000","last_peered":"2024-09-11T14:30:01.289026+0000","last_clean":"2024-09-11T14:30:01.289026+0000","last_became_active":"2024-09-11T14:16:01.475901+0000","last_became_peered":"2024-09-11T14:16:01.475901+0000","last_unstale":"2024-09-11T14:30:01.289026+0000","last_undegraded":"2024-09-11T14:30:01.289026+0000","last_fullsized":"2024-09-11T14:30:01.289026+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.318649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.318649+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.832193+0000","last_change":"2024-09-11T14:30:00.843275+0000","last_active":"2024-09-11T14:30:00.832193+0000","last_peered":"2024-09-11T14:30:00.832193+0000","last_clean":"2024-09-11T14:30:00.832193+0000","last_became_active":"2024-09-11T14:16:01.485861+0000","last_became_peered":"2024-09-11T14:16:01.485861+0000","last_unstale":"2024-09-11T14:30:00.832193+0000","last_undegraded":"2024-09-11T14:30:00.832193+0000","last_fullsized":"2024-09-11T14:30:00.832193+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.843079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.843079+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.360599+0000","last_change":"2024-09-11T14:30:00.378614+0000","last_active":"2024-09-11T14:30:00.360599+0000","last_peered":"2024-09-11T14:30:00.360599+0000","last_clean":"2024-09-11T14:30:00.360599+0000","last_became_active":"2024-09-11T14:16:01.497752+0000","last_became_peered":"2024-09-11T14:16:01.497752+0000","last_unstale":"2024-09-11T14:30:00.360599+0000","last_undegraded":"2024-09-11T14:30:00.360599+0000","last_fullsized":"2024-09-11T14:30:00.360599+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.378329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.378329+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.359863+0000","last_change":"2024-09-11T14:30:00.377022+0000","last_active":"2024-09-11T14:30:00.359863+0000","last_peered":"2024-09-11T14:30:00.359863+0000","last_clean":"2024-09-11T14:30:00.359863+0000","last_became_active":"2024-09-11T14:16:01.540272+0000","last_became_peered":"2024-09-11T14:16:01.540272+0000","last_unstale":"2024-09-11T14:30:00.359863+0000","last_undegraded":"2024-09-11T14:30:00.359863+0000","last_fullsized":"2024-09-11T14:30:00.359863+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.376742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.376742+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.358317+0000","last_change":"2024-09-11T14:30:00.379605+0000","last_active":"2024-09-11T14:30:00.358317+0000","last_peered":"2024-09-11T14:30:00.358317+0000","last_clean":"2024-09-11T14:30:00.358317+0000","last_became_active":"2024-09-11T14:16:01.516906+0000","last_became_peered":"2024-09-11T14:16:01.516906+0000","last_unstale":"2024-09-11T14:30:00.358317+0000","last_undegraded":"2024-09-11T14:30:00.358317+0000","last_fullsized":"2024-09-11T14:30:00.358317+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.379353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.379353+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.829822+0000","last_change":"2024-09-11T14:30:00.848611+0000","last_active":"2024-09-11T14:30:00.829822+0000","last_peered":"2024-09-11T14:30:00.829822+0000","last_clean":"2024-09-11T14:30:00.829822+0000","last_became_active":"2024-09-11T14:16:01.524168+0000","last_became_peered":"2024-09-11T14:16:01.524168+0000","last_unstale":"2024-09-11T14:30:00.829822+0000","last_undegraded":"2024-09-11T14:30:00.829822+0000","last_fullsized":"2024-09-11T14:30:00.829822+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.848427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.848427+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.291615+0000","last_change":"2024-09-11T14:30:01.322101+0000","last_active":"2024-09-11T14:30:01.291615+0000","last_peered":"2024-09-11T14:30:01.291615+0000","last_clean":"2024-09-11T14:30:01.291615+0000","last_became_active":"2024-09-11T14:16:01.519043+0000","last_became_peered":"2024-09-11T14:16:01.519043+0000","last_unstale":"2024-09-11T14:30:01.291615+0000","last_undegraded":"2024-09-11T14:30:01.291615+0000","last_fullsized":"2024-09-11T14:30:01.291615+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.321888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.321888+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.288662+0000","last_change":"2024-09-11T14:30:01.314526+0000","last_active":"2024-09-11T14:30:01.288662+0000","last_peered":"2024-09-11T14:30:01.288662+0000","last_clean":"2024-09-11T14:30:01.288662+0000","last_became_active":"2024-09-11T14:16:01.508423+0000","last_became_peered":"2024-09-11T14:16:01.508423+0000","last_unstale":"2024-09-11T14:30:01.288662+0000","last_undegraded":"2024-09-11T14:30:01.288662+0000","last_fullsized":"2024-09-11T14:30:01.288662+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.314322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.314322+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.889749+0000","last_change":"2024-09-11T14:29:59.905628+0000","last_active":"2024-09-11T14:29:59.889749+0000","last_peered":"2024-09-11T14:29:59.889749+0000","last_clean":"2024-09-11T14:29:59.889749+0000","last_became_active":"2024-09-11T14:16:01.505280+0000","last_became_peered":"2024-09-11T14:16:01.505280+0000","last_unstale":"2024-09-11T14:29:59.889749+0000","last_undegraded":"2024-09-11T14:29:59.889749+0000","last_fullsized":"2024-09-11T14:29:59.889749+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.905354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.905354+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.289507+0000","last_change":"2024-09-11T14:30:01.315513+0000","last_active":"2024-09-11T14:30:01.289507+0000","last_peered":"2024-09-11T14:30:01.289507+0000","last_clean":"2024-09-11T14:30:01.289507+0000","last_became_active":"2024-09-11T14:16:01.573403+0000","last_became_peered":"2024-09-11T14:16:01.573403+0000","last_unstale":"2024-09-11T14:30:01.289507+0000","last_undegraded":"2024-09-11T14:30:01.289507+0000","last_fullsized":"2024-09-11T14:30:01.289507+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.315300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.315300+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.890635+0000","last_change":"2024-09-11T14:29:59.908482+0000","last_active":"2024-09-11T14:29:59.890635+0000","last_peered":"2024-09-11T14:29:59.890635+0000","last_clean":"2024-09-11T14:29:59.890635+0000","last_became_active":"2024-09-11T14:16:01.607437+0000","last_became_peered":"2024-09-11T14:16:01.607437+0000","last_unstale":"2024-09-11T14:29:59.890635+0000","last_undegraded":"2024-09-11T14:29:59.890635+0000","last_fullsized":"2024-09-11T14:29:59.890635+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.908317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.908317+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.889785+0000","last_change":"2024-09-11T14:29:59.910852+0000","last_active":"2024-09-11T14:29:59.889785+0000","last_peered":"2024-09-11T14:29:59.889785+0000","last_clean":"2024-09-11T14:29:59.889785+0000","last_became_active":"2024-09-11T14:16:01.520713+0000","last_became_peered":"2024-09-11T14:16:01.520713+0000","last_unstale":"2024-09-11T14:29:59.889785+0000","last_undegraded":"2024-09-11T14:29:59.889785+0000","last_fullsized":"2024-09-11T14:29:59.889785+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.910689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.910689+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.888091+0000","last_change":"2024-09-11T14:29:59.902385+0000","last_active":"2024-09-11T14:29:59.888091+0000","last_peered":"2024-09-11T14:29:59.888091+0000","last_clean":"2024-09-11T14:29:59.888091+0000","last_became_active":"2024-09-11T14:16:01.470273+0000","last_became_peered":"2024-09-11T14:16:01.470273+0000","last_unstale":"2024-09-11T14:29:59.888091+0000","last_undegraded":"2024-09-11T14:29:59.888091+0000","last_fullsized":"2024-09-11T14:29:59.888091+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.902219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.902219+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1472,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.358734+0000","last_change":"2024-09-11T14:30:00.383279+0000","last_active":"2024-09-11T14:30:00.358734+0000","last_peered":"2024-09-11T14:30:00.358734+0000","last_clean":"2024-09-11T14:30:00.358734+0000","last_became_active":"2024-09-11T14:16:01.504043+0000","last_became_peered":"2024-09-11T14:16:01.504043+0000","last_unstale":"2024-09-11T14:30:00.358734+0000","last_undegraded":"2024-09-11T14:30:00.358734+0000","last_fullsized":"2024-09-11T14:30:00.358734+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-09-11T14:30:00.383086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.383086+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.831052+0000","last_change":"2024-09-11T14:30:00.847468+0000","last_active":"2024-09-11T14:30:00.831052+0000","last_peered":"2024-09-11T14:30:00.831052+0000","last_clean":"2024-09-11T14:30:00.831052+0000","last_became_active":"2024-09-11T14:16:01.479206+0000","last_became_peered":"2024-09-11T14:16:01.479206+0000","last_unstale":"2024-09-11T14:30:00.831052+0000","last_undegraded":"2024-09-11T14:30:00.831052+0000","last_fullsized":"2024-09-11T14:30:00.831052+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.847293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.847293+0000","last_clean_scrub_stamp":"2024-09-11T14:16:00.357279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2135,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.357833+0000","last_change":"2024-09-11T14:30:00.383915+0000","last_active":"2024-09-11T14:30:00.357833+0000","last_peered":"2024-09-11T14:30:00.357833+0000","last_clean":"2024-09-11T14:30:00.357833+0000","last_became_active":"2024-09-11T14:10:59.620325+0000","last_became_peered":"2024-09-11T14:10:59.620325+0000","last_unstale":"2024-09-11T14:30:00.357833+0000","last_undegraded":"2024-09-11T14:30:00.357833+0000","last_fullsized":"2024-09-11T14:30:00.357833+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.383724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.383724+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2135,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.829943+0000","last_change":"2024-09-11T14:30:00.841360+0000","last_active":"2024-09-11T14:30:00.829943+0000","last_peered":"2024-09-11T14:30:00.829943+0000","last_clean":"2024-09-11T14:30:00.829943+0000","last_became_active":"2024-09-11T14:10:59.608924+0000","last_became_peered":"2024-09-11T14:10:59.608924+0000","last_unstale":"2024-09-11T14:30:00.829943+0000","last_undegraded":"2024-09-11T14:30:00.829943+0000","last_fullsized":"2024-09-11T14:30:00.829943+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.841148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.841148+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2135,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.288880+0000","last_change":"2024-09-11T14:30:01.328010+0000","last_active":"2024-09-11T14:30:01.288880+0000","last_peered":"2024-09-11T14:30:01.288880+0000","last_clean":"2024-09-11T14:30:01.288880+0000","last_became_active":"2024-09-11T14:10:59.609479+0000","last_became_peered":"2024-09-11T14:10:59.609479+0000","last_unstale":"2024-09-11T14:30:01.288880+0000","last_undegraded":"2024-09-11T14:30:01.288880+0000","last_fullsized":"2024-09-11T14:30:01.288880+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:01.327802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.327802+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2135,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.827427+0000","last_change":"2024-09-11T14:30:00.844276+0000","last_active":"2024-09-11T14:30:00.827427+0000","last_peered":"2024-09-11T14:30:00.827427+0000","last_clean":"2024-09-11T14:30:00.827427+0000","last_became_active":"2024-09-11T14:10:59.602609+0000","last_became_peered":"2024-09-11T14:10:59.602609+0000","last_unstale":"2024-09-11T14:30:00.827427+0000","last_undegraded":"2024-09-11T14:30:00.827427+0000","last_fullsized":"2024-09-11T14:30:00.827427+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.844069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.844069+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":2137,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.888094+0000","last_change":"2024-09-11T14:29:59.907872+0000","last_active":"2024-09-11T14:29:59.888094+0000","last_peered":"2024-09-11T14:29:59.888094+0000","last_clean":"2024-09-11T14:29:59.888094+0000","last_became_active":"2024-09-11T14:10:59.606917+0000","last_became_peered":"2024-09-11T14:10:59.606917+0000","last_unstale":"2024-09-11T14:29:59.888094+0000","last_undegraded":"2024-09-11T14:29:59.888094+0000","last_fullsized":"2024-09-11T14:29:59.888094+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-11T14:29:59.907590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.907590+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2135,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.356127+0000","last_change":"2024-09-11T14:30:00.373227+0000","last_active":"2024-09-11T14:30:00.356127+0000","last_peered":"2024-09-11T14:30:00.356127+0000","last_clean":"2024-09-11T14:30:00.356127+0000","last_became_active":"2024-09-11T14:10:59.605060+0000","last_became_peered":"2024-09-11T14:10:59.605060+0000","last_unstale":"2024-09-11T14:30:00.356127+0000","last_undegraded":"2024-09-11T14:30:00.356127+0000","last_fullsized":"2024-09-11T14:30:00.356127+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:30:00.372951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.372951+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2135,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:29:59.888089+0000","last_change":"2024-09-11T14:29:59.909864+0000","last_active":"2024-09-11T14:29:59.888089+0000","last_peered":"2024-09-11T14:29:59.888089+0000","last_clean":"2024-09-11T14:29:59.888089+0000","last_became_active":"2024-09-11T14:10:59.611356+0000","last_became_peered":"2024-09-11T14:10:59.611356+0000","last_unstale":"2024-09-11T14:29:59.888089+0000","last_undegraded":"2024-09-11T14:29:59.888089+0000","last_fullsized":"2024-09-11T14:29:59.888089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:29:59.909638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:29:59.909638+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":2136,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:00.357954+0000","last_change":"2024-09-11T14:30:00.390152+0000","last_active":"2024-09-11T14:30:00.357954+0000","last_peered":"2024-09-11T14:30:00.357954+0000","last_clean":"2024-09-11T14:30:00.357954+0000","last_became_active":"2024-09-11T14:10:59.621273+0000","last_became_peered":"2024-09-11T14:10:59.621273+0000","last_unstale":"2024-09-11T14:30:00.357954+0000","last_undegraded":"2024-09-11T14:30:00.357954+0000","last_fullsized":"2024-09-11T14:30:00.357954+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-11T14:30:00.389970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:00.389970+0000","last_clean_scrub_stamp":"2024-09-11T14:10:58.550701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2204,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-11T14:30:01.286139+0000","last_change":"2024-09-11T14:30:01.329260+0000","last_active":"2024-09-11T14:30:01.286139+0000","last_peered":"2024-09-11T14:30:01.286139+0000","last_clean":"2024-09-11T14:30:01.286139+0000","last_became_active":"2024-09-11T14:10:58.597128+0000","last_became_peered":"2024-09-11T14:10:58.597128+0000","last_unstale":"2024-09-11T14:30:01.286139+0000","last_undegraded":"2024-09-11T14:30:01.286139+0000","last_fullsized":"2024-09-11T14:30:01.286139+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-11T14:30:01.329043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:30:01.329043+0000","last_clean_scrub_stamp":"2024-09-11T14:10:57.546724+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70580,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301260,"statfs":{"total":96636764160,"available":96564490240,"internally_reserved":0,"allocated":3575808,"data_stored":1945458,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66368,"kb_used_data":3440,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305472,"statfs":{"total":96636764160,"available":96568803328,"internally_reserved":0,"allocated":3522560,"data_stored":1355114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64956,"kb_used_data":3436,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306884,"statfs":{"total":96636764160,"available":96570249216,"internally_reserved":0,"allocated":3518464,"data_stored":1355095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65016,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306824,"statfs":{"total":96636764160,"available":96570187776,"internally_reserved":0,"allocated":3579904,"data_stored":1945477,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30045,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:30:42.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T14:30:42.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.418+0000 7f1b58b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:42.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.427+0000 7f1b58b51640 1 Processor -- start 2024-09-11T14:30:42.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.427+0000 7f1b58b51640 1 -- start start 2024-09-11T14:30:42.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b58b51640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b54132df0 0x7f1b54133200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:42.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b58b51640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b541329c0 con 0x7f1b5409db60 2024-09-11T14:30:42.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b58b51640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5406fd70 con 0x7f1b54132df0 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b5259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b54132df0 0x7f1b54133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b5259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b54132df0 0x7f1b54133200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41564/0 (socket says 172.21.15.97:41564) 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b5259c640 1 -- 172.21.15.97:0/3998960216 learned_addr learned my addr 172.21.15.97:0/3998960216 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b4bfff640 1 --1- 172.21.15.97:0/3998960216 >> v1:172.21.15.97:6789/0 conn(0x7f1b5409db60 0x7f1b5409df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45972/0 (socket says 172.21.15.97:45972) 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b5259c640 1 -- 172.21.15.97:0/3998960216 >> v1:172.21.15.97:6789/0 conn(0x7f1b5409db60 legacy=0x7f1b5409df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b5259c640 1 -- 172.21.15.97:0/3998960216 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5406f8f0 con 0x7f1b54132df0 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.428+0000 7f1b51d9b640 1 -- 172.21.15.97:0/3998960216 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927631505 0 0) 0x7f1b541329c0 con 0x7f1b5409db60 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.429+0000 7f1b5259c640 1 --2- 172.21.15.97:0/3998960216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b54132df0 0x7f1b54133200 crc :-1 s=READY pgs=13044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b340983bdeb12c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.429+0000 7f1b51d9b640 1 -- 172.21.15.97:0/3998960216 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b44010570 con 0x7f1b54132df0 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.429+0000 7f1b51d9b640 1 -- 172.21.15.97:0/3998960216 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1b440106d0 con 0x7f1b54132df0 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.429+0000 7f1b51d9b640 1 -- 172.21.15.97:0/3998960216 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b44010970 con 0x7f1b54132df0 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.429+0000 7f1b58b51640 1 -- 172.21.15.97:0/3998960216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b54132df0 msgr2=0x7f1b54133200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.429+0000 7f1b58b51640 1 --2- 172.21.15.97:0/3998960216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b54132df0 0x7f1b54133200 crc :-1 s=READY pgs=13044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.430+0000 7f1b58b51640 1 -- 172.21.15.97:0/3998960216 shutdown_connections 2024-09-11T14:30:42.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.430+0000 7f1b58b51640 1 --2- 172.21.15.97:0/3998960216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b54132df0 0x7f1b54133200 unknown :-1 s=CLOSED pgs=13044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.430+0000 7f1b58b51640 1 -- 172.21.15.97:0/3998960216 >> 172.21.15.97:0/3998960216 conn(0x7f1b540a29e0 msgr2=0x7f1b540a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:42.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.430+0000 7f1b58b51640 1 -- 172.21.15.97:0/3998960216 shutdown_connections 2024-09-11T14:30:42.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.430+0000 7f1b58b51640 1 -- 172.21.15.97:0/3998960216 wait complete. 2024-09-11T14:30:42.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.430+0000 7f1b58b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:42.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.432+0000 7f1b58b51640 1 Processor -- start 2024-09-11T14:30:42.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.432+0000 7f1b58b51640 1 -- start start 2024-09-11T14:30:42.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b58b51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b5409db60 0x7f1b5411c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:42.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b58b51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5411d470 con 0x7f1b5409db60 2024-09-11T14:30:42.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b5259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b5409db60 0x7f1b5411c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:42.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b5259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b5409db60 0x7f1b5411c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41574/0 (socket says 172.21.15.97:41574) 2024-09-11T14:30:42.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b5259c640 1 -- 172.21.15.97:0/786224940 learned_addr learned my addr 172.21.15.97:0/786224940 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-11T14:30:42.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b5259c640 1 -- 172.21.15.97:0/786224940 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b541200d0 con 0x7f1b5409db60 2024-09-11T14:30:42.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b5259c640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b5409db60 0x7f1b5411c130 crc :-1 s=READY pgs=13045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:42.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b44017040 con 0x7f1b5409db60 2024-09-11T14:30:42.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5411db70 con 0x7f1b5409db60 2024-09-11T14:30:42.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.433+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1b4400f720 con 0x7f1b5409db60 2024-09-11T14:30:42.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.434+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b4400f9c0 con 0x7f1b5409db60 2024-09-11T14:30:42.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.434+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b541302e0 con 0x7f1b5409db60 2024-09-11T14:30:42.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.434+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b540772e0 con 0x7f1b5409db60 2024-09-11T14:30:42.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.435+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1b4400fbc0 con 0x7f1b5409db60 2024-09-11T14:30:42.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.435+0000 7f1b4affd640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1b3403e8e0 0x7f1b34040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:30:42.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.435+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(720..720 src has 397..720) ==== 3431+0+0 (crc 0 0 0) 0x7f1b440534f0 con 0x7f1b5409db60 2024-09-11T14:30:42.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.435+0000 7f1b4bfff640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1b3403e8e0 0x7f1b34040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:30:42.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.436+0000 7f1b4bfff640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1b3403e8e0 0x7f1b34040df0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:30:42.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.440+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1b4400e6f0 con 0x7f1b5409db60 2024-09-11T14:30:42.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.617+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1b54077600 con 0x7f1b5409db60 2024-09-11T14:30:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.622+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f1b44009250 con 0x7f1b5409db60 2024-09-11T14:30:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.623+0000 7f1b4affd640 1 -- 172.21.15.97:0/786224940 <== mon.0 v2:172.21.15.97:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f1b4400e6f0 con 0x7f1b5409db60 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1b3403e8e0 msgr2=0x7f1b34040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1b3403e8e0 0x7f1b34040df0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b5409db60 msgr2=0x7f1b5411c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b5409db60 0x7f1b5411c130 crc :-1 s=READY pgs=13045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 shutdown_connections 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.117:6800/3188360781,v1:172.21.15.117:6801/3188360781] conn(0x7f1b3403e8e0 0x7f1b34040df0 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 --2- 172.21.15.97:0/786224940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b5409db60 0x7f1b5411c130 unknown :-1 s=CLOSED pgs=13045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 >> 172.21.15.97:0/786224940 conn(0x7f1b540a29e0 msgr2=0x7f1b540a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 shutdown_connections 2024-09-11T14:30:42.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-11T14:30:42.625+0000 7f1b58b51640 1 -- 172.21.15.97:0/786224940 wait complete. 2024-09-11T14:30:42.641 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T14:30:42.641 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T14:30:42.642 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T14:30:42.642 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:30:42.711 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T14:30:42.712 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T14:30:42.712 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:30:42.796 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T14:30:42.797 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T14:30:42.797 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:30:42.883 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T14:30:42.883 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T14:30:42.884 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:30:42.971 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T14:30:42.971 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T14:30:42.971 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T14:30:42.971 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:30:42.999 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T14:30:43.000 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T14:30:43.000 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T14:30:43.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:30:43.014 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T14:30:43.014 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T14:30:43.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-11T14:30:43.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-11T14:30:43.090 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T14:30:43.270 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-11T14:30:43.270 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T14:30:43.368 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T14:30:43.368 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T14:30:43.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T14:30:43.521 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T14:30:43.576 INFO:tasks.ceph:Archiving mon data... 2024-09-11T14:30:43.577 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306/data/mon.a.tgz 2024-09-11T14:30:43.577 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-11T14:30:43.593 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.zLLL3EoERq 2024-09-11T14:30:43.593 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zLLL3EoERq 2024-09-11T14:30:43.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.zLLL3EoERq 2024-09-11T14:30:43.848 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.zLLL3EoERq is 313KB 2024-09-11T14:30:43.947 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.zLLL3EoERq 2024-09-11T14:30:43.961 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T14:30:43.962 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:30:44.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:30:44.081 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:30:44.100 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:30:44.100 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T14:30:44.102 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306/remote/smithi097/crash 2024-09-11T14:30:44.102 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:30:44.146 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306/remote/smithi117/crash 2024-09-11T14:30:44.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:30:44.193 INFO:tasks.ceph:Compressing logs... 2024-09-11T14:30:44.193 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:30:44.196 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:30:44.226 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28095.log 2024-09-11T14:30:44.226 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28175.log 2024-09-11T14:30:44.226 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28044.log 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28175.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28095.log.gz 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28175.log.gz 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28135.log 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.28044.log.gz 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.28135.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T14:30:44.227 INFO:teuthology.orchestra.run.smithi117.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.28135.log.gz 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31351.log 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94128.log 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.31351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96067.log 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31408.log 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96151.log 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96625.log 2024-09-11T14:30:44.284 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96067.log.gz 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28812.log 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31408.log.gz 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96151.log.gz 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96312.log 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.28812.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96625.log.gz 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96452.log 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28812.log.gz 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29125.log 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96452.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96312.log.gz 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95571.log 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96452.log.gz 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94746.log 2024-09-11T14:30:44.285 INFO:teuthology.orchestra.run.smithi097.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29125.log.gz 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95571.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96286.log 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95771.log 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97191.log 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96286.log.gz 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95771.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94746.log.gz 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29434.log 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97191.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97191.log.gz 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.95571.log.gz 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94364.log 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96193.log 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr: 86.7%/var/log/ceph/ceph-client.admin.94364.log: -- replaced with /var/log/ceph/ceph-client.admin.29434.log.gz 2024-09-11T14:30:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96220.log 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 90.6% --verbose -- /var/log/ceph/ceph-client.admin.29435.log 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94364.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96193.log: /var/log/ceph/ceph-client.admin.96220.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96193.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.96220.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.31351.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94277.log 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.94128.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96130.log 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94277.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29435.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97360.log 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29604.log 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.94277.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97360.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96130.log.gz 2024-09-11T14:30:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94501.log 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97360.log.gz 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29436.log 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94501.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29604.log.gz 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96734.log 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29713.log 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94501.log.gz 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94568.log 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29436.log.gz 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94049.log 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.96734.log.gz 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29713.log: /var/log/ceph/ceph-client.admin.94568.log: 86.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97444.log 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29713.log.gz 2024-09-11T14:30:44.288 INFO:teuthology.orchestra.run.smithi097.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.94568.log.gz 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95359.log 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29602.log 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97444.log: /var/log/ceph/ceph-client.admin.95359.log: gzip 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97444.log.gz 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94603.log 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94049.log.gz 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97318.log 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29602.log.gz 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.95771.log.gz 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94729.log 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97526.log 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97318.log.gz 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94729.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94603.log.gz 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29251.log 2024-09-11T14:30:44.289 INFO:teuthology.orchestra.run.smithi097.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94729.log.gz 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31389.log 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29251.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.97526.log.gz 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93074.log 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29251.log.gz 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96311.log 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94276.log 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93074.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.95359.log.gz 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31389.log.gz 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94810.log 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97402.log 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94276.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96311.log.gz 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94567.log 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94276.log.gz 2024-09-11T14:30:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96428.log 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: 85.4%gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97402.log.gz/var/log/ceph/ceph-client.admin.94567.log: 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28576.log 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: gzip 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96428.log.gz 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97234.log 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94567.log.gz 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95252.log 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.28576.log: /var/log/ceph/ceph-client.admin.97234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96710.log 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: 84.5%/var/log/ceph/ceph-client.admin.95252.log: -- replaced with /var/log/ceph/ceph-client.admin.28576.log.gz 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97234.log.gz 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96689.log 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: 92.0% 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T14:30:44.291 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94810.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96172.log 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96710.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.95252.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96783.log 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96380.log 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96689.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96783.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96172.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96109.log 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96783.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96980.log 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96109.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96380.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29437.log 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96109.log.gz 2024-09-11T14:30:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95952.log 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.96980.log.gz 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93557.log 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29437.log: /var/log/ceph/ceph-client.admin.95952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96499.log 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29437.log.gz 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.95952.log.gz 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94676.log 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96520.log 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96499.log.gz 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93538.log 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.93557.log.gz 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95979.log 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94676.log.gz 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93538.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96520.log.gz 2024-09-11T14:30:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96046.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93538.log.gz 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93577.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94314.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95979.log.gz 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96046.log: /var/log/ceph/ceph-client.admin.93577.log: gzip -5 87.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.96046.log.gz /var/log/ceph/ceph-client.admin.95739.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29293.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94314.log: /var/log/ceph/ceph-client.admin.95739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96759.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93577.log.gz/var/log/ceph/ceph-client.admin.29293.log: 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97486.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94314.log.gz 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29293.log.gz 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95739.log.gz 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96667.log 2024-09-11T14:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96025.log 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97486.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96759.log.gz 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93402.log 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97486.log.gz 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96667.log.gz 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93663.log 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93402.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96025.log.gz 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97148.log 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94418.log 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94256.log 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97148.log.gz 2024-09-11T14:30:44.295 INFO:teuthology.orchestra.run.smithi097.stderr: 95.1% 91.1%/var/log/ceph/ceph-client.admin.94418.log: -- replaced with /var/log/ceph/ceph-client.admin.93663.log.gz 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93074.log.gz 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94363.log 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93402.log.gz 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93146.log 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94363.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.94418.log.gz 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97276.log 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96541.log 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97276.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94363.log.gz 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93146.log.gz 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr: -5 92.0% -- replaced with /var/log/ceph/ceph-client.admin.94256.log.gz 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97106.log 2024-09-11T14:30:44.296 INFO:teuthology.orchestra.run.smithi097.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97276.log.gz 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28655.log 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96541.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96541.log.gz 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94793.log 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94312.log 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97106.log.gz 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.28655.log: /var/log/ceph/ceph-client.admin.94793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96896.log 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28655.log.gz 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.94793.log.gz 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94641.log 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93714.log 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94641.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96896.log.gz 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94312.log.gz 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31312.log 2024-09-11T14:30:44.297 INFO:teuthology.orchestra.run.smithi097.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.94641.log.gz 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93714.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31427.log 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31312.log.gz 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93596.log 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93519.log 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.93596.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94499.log 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93519.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93519.log.gz 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30485.log 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.93596.log.gz 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94640.log 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30485.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.93714.log.gz 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94499.log.gz 2024-09-11T14:30:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28840.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29335.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.28840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94604.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28840.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94640.log.gz 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94500.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29209.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29335.log.gz 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.94604.log.gz 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94415.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29209.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.94500.log.gz 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96938.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29209.log.gz 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96265.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94415.log: /var/log/ceph/ceph-client.admin.96938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29605.log 2024-09-11T14:30:44.299 INFO:teuthology.orchestra.run.smithi097.stderr: 85.5%/var/log/ceph/ceph-client.admin.96265.log: -- replaced with /var/log/ceph/ceph-client.admin.96938.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94415.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96265.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95022.log 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96583.log 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29605.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93365.log 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95022.log: /var/log/ceph/ceph-client.admin.96583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97064.log 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7%/var/log/ceph/ceph-client.admin.93365.log: -- replaced with /var/log/ceph/ceph-client.admin.96583.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.93365.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96478.log 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96562.log 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96478.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97064.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96478.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29755.log 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96562.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96562.log.gz 2024-09-11T14:30:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30016.log 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94365.log 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30016.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29755.log.gz 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29150.log 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94365.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94365.log.gz 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96356.log 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29150.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.30485.log.gz 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29150.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94677.log 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94313.log 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95022.log.gz 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94677.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96356.log.gz 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94678.log 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.94677.log.gz 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96219.log/var/log/ceph/ceph-client.admin.94313.log: 2024-09-11T14:30:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31259.log 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.94313.log.gz 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96219.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.94678.log.gz 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29603.log 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96219.log.gz 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95070.log 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29069.log 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.30016.log.gz 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29603.log.gz 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31259.log.gz 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96604.log 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97022.log 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29069.log.gz/var/log/ceph/ceph-client.admin.96604.log: 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94416.log 2024-09-11T14:30:44.302 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96604.log.gz 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29797.log 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97022.log: /var/log/ceph/ceph-client.admin.94416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31293.log 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.97022.log.gz 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.29797.log: 85.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96646.log 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29797.log.gz 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94416.log.gz 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.95070.log.gz 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31293.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27500.log 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.96646.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96088.log 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.tmp-client.admin.27500.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96646.log.gz 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr: 66.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96402.log 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.27500.log.gz 2024-09-11T14:30:44.303 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96004.log 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93184.log 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96088.log.gz 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96402.log.gz 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94417.log 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93184.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31293.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94275.log 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96004.log.gz 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95917.log 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94414.log 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94417.log.gz 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.94275.log.gz 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95917.log: 86.3% 91.7% -- replaced with /var/log/ceph/ceph-client.admin.95917.log.gz 2024-09-11T14:30:44.304 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93184.log.gz 2024-09-11T14:30:44.305 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94414.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94414.log.gz 2024-09-11T14:30:44.411 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-osd.3.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T14:30:44.687 INFO:teuthology.orchestra.run.smithi097.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31427.log.gz 2024-09-11T14:30:45.773 INFO:teuthology.orchestra.run.smithi097.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T14:30:50.509 INFO:teuthology.orchestra.run.smithi097.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T14:30:50.519 INFO:teuthology.orchestra.run.smithi117.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T14:30:50.573 INFO:teuthology.orchestra.run.smithi117.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T14:30:50.575 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-11T14:30:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m6.363s 2024-09-11T14:30:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m12.336s 2024-09-11T14:30:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.492s 2024-09-11T14:30:50.884 INFO:teuthology.orchestra.run.smithi097.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T14:30:50.886 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-11T14:30:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m6.678s 2024-09-11T14:30:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m14.480s 2024-09-11T14:30:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m0.665s 2024-09-11T14:30:50.887 INFO:tasks.ceph:Archiving logs... 2024-09-11T14:30:50.887 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306/remote/smithi097/log 2024-09-11T14:30:50.888 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:30:53.404 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306/remote/smithi117/log 2024-09-11T14:30:53.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:30:55.457 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T14:30:55.467 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T14:30:55.467 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:30:55.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:30:55.554 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T14:30:55.563 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T14:30:55.563 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:30:55.566 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:30:55.580 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:30:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:30:55.589 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:30:55.589 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-11T14:30:55.589 INFO:teuthology.orchestra.run.smithi097.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +560us[ +573us] +/- 39ms 2024-09-11T14:30:55.589 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -486us[ -473us] +/- 70ms 2024-09-11T14:30:55.589 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -510us[ -497us] +/- 69ms 2024-09-11T14:30:55.589 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:30:55.590 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:30:55.590 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-11T14:30:55.590 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +566us[ +560us] +/- 39ms 2024-09-11T14:30:55.590 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 -481us[ -481us] +/- 70ms 2024-09-11T14:30:55.590 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -505us[ -510us] +/- 69ms 2024-09-11T14:30:55.591 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:30:55.591 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T14:30:55.599 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T14:30:55.600 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T14:30:55.608 DEBUG:teuthology.orchestra.run.smithi097:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:30:55.697 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:30:55.763 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:30:55.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:30:55.793 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:30:55.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:30:55.822 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T14:30:55.832 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T14:30:55.840 INFO:teuthology.task.internal:Duration was 1634.212863 seconds 2024-09-11T14:30:55.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T14:30:55.849 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T14:30:55.849 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:30:55.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:30:55.891 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:30:55.904 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:30:56.218 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T14:30:56.218 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-09-11T14:30:56.218 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:30:56.280 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T14:30:56.280 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:30:56.310 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T14:30:56.311 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:30:56.322 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:30:56.378 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T14:30:56.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:30:56.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:30:56.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T14:30:56.529 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T14:30:56.529 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:30:56.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:30:56.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T14:30:56.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:30:56.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:30:56.618 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-09-11T14:30:56.642 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-11T14:30:56.665 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:30:56.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:30:56.685 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:30:56.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:30:56.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T14:30:56.734 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T14:30:56.735 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306/remote/smithi097 2024-09-11T14:30:56.735 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:30:56.774 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901306/remote/smithi117 2024-09-11T14:30:56.774 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:30:56.807 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T14:30:56.807 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:30:56.810 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:30:56.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T14:30:56.868 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T14:30:56.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T14:30:56.877 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T14:30:56.878 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:30:56.880 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:30:56.892 INFO:teuthology.orchestra.run.smithi097.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:30 /home/ubuntu/cephtest 2024-09-11T14:30:56.911 INFO:teuthology.orchestra.run.smithi117.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:30 /home/ubuntu/cephtest 2024-09-11T14:30:56.912 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T14:30:56.923 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T14:30:56.945 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} duration: 1634.2128632068634 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-11T14:30:56.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:30:57.030 INFO:teuthology.run:pass